The main contributions of this chapter can be summarized as follows:
• Our approach tries to obtain a reusable and portable software that could be used by different web agents to extract knowledge from specific web sources.
• The utilization of rules provides two advantages: the flexible modification of the parser behavior when the source changes; and easy reutilization of the well-tested rules for similar web sources.
• Once the API of the WebParser is analyzed by the programmer, it is easy to use it as a new skill module inside the web agent. This could improve the implementation of web-based multi-agent systems and gathering systems.
Currently, we have implemented an initial version of the WebParser, and have integrated it into several web agents that belong to a simple multi-agent web system.
However, there are several important points that will be addressed to obtain a fully portable and reusable software for extracting web knowledge.
These points can be summarized as:
• To study the flexibility of the rules that can be defined in the WebParser.
Is it possible to extract other types of stored knowledge with this simple representation?
• To study other agent-based and multi-agent technologies and frameworks that actually have been used by different researchers and companies, including ZEUS (Collis et al., 1998) and JATLite (Petrie, 1996), and to see if it is possible to implement web or wrapper agents which integrate the parser inside the agents implemented with those technologies.
REFERENCES
Ashish, N. & Knoblock, C. A. (1997). Semi-automatic wrapper generation for Internet information sources. Second IFCIS Conference on Coop-erative Information Systems (CoopIS), Charleston, South Carolina.
Baeza-Yates, R. & Ribeiro-Neto, B. (1999). Modern Information Re-trieval. Boston, MA: Addison-Wesley Longman.
Balabanovic, M., Shoham, Y., & Yun, T. (1995). An adaptive agent for automated web browsing.
Bellifemine, F., Poggi, A., & Rimassa, G. (1999). Jade - A FIPA-compliant agent framework. In Proceedings of the Conference on Practical Applications of Agents and Multi-Agents (PAAM’99), London (pp.
97-108).
Berners-Lee, T., Hendler, J., & Lassila, O. (2001). The semantic web.
Scientific American.
Bremer, J. M. & Gertz, M. (2002). Xquery/ir: Integrating XML documents and data retrieval.
Camacho, D., Aler, R., Castro, C., & Molina J. M. (2002). Performance evaluation of Zeus, Jade and skeleton agent frameworks. In Proceedings of the IEEE Systems, Man, and Cybernectics Conference (SMC-2002), Hammamet, Tunisia. New York: IEEE Press.
Camacho, D., Molina J. M., Borrajo, D., & Aler, R. (2002). Mapweb:
Cooperation between planning agents and web agents. Information &
Security: An International Journal, Special issue on Multi-agent Technologies, 8.
Camacho, D., Molina J. M., Borrajo, D., & Aler, R. (2002). Solving travel problems by integrating web information with planning. In Proceedings of the 13th International Symposium on Methodologies for Intelligent Systems (ISMIS 2002), Lyon, France. Berlin: Springer-Verlag.
Chen, H., Chung, Y., Ramsey, M., & Yang, C. (2001). A smart itsy bitsy spider for the Web. Journal of the American Society for Information Science.
Collis, J., Ndumu, D., Nwana, H. S., & Lee, L. (1998). The Zeus agent building tool-kit. The British Telecom Technology Journal, 16(3), 60-68.
Decker, K., Sycara, K. & Williamson, M. (1997). Middle-agents for the Internet. Proceedings of the 15th International Joint Conference on Artificial Intelligence, Nagoya, Japan.
Fan, Y. & Gauch, S. (1999). Adaptive agents for information gathering from multiple, distributed information sources. Proceedings of the 1999 AAAI Symposium on Intelligent Agents in Cyberspace, Stanford University, California.
Finin, T., Fritzson, R., Mackay, D. & McEntire, R. (1994). KQML as an agent communication language. In Proceedings of the 3rd International Conference on Information and Knowledge Management (CIKM94), Gaithersburg, Maryland (pp. 456-463). New York: ACM Press.
FIPA.org. (1997) Agent communication language. Foundation for Intelli-gent Physical AIntelli-gents. (Technical Report)
Freitag, D. (1998). Information extraction from HTML: Application of a general learning approach. In Proceedings of the 15th National Con-ference on Artificial Intelligence (AAAI-98). Menlo Park, CA: AAAI Press.
Gruber, T. R. (1993). A translation approach to portable ontologies. Knowl-edge Acquisition, 5(2), 199-220.
Howe, A. E. & Dreilinger, D. (1997). Savvysearch: A metasearch engine that learns which search engines to query. AI Magazine, 18(2), 19-25.
Jones, K. S. & Willett, P. (1997). Readings in Information Retrieval. San Francisco, CA: Morgan Kaufmann.
Knoblock, C. A. et al. (2000). The Ariadne approach to web-based informa-tion integrainforma-tion. Internainforma-tional Journal on Cooperative Informainforma-tion Systems (IJCIS) Special Issue on Intelligent Information Agents:
Theory and Applications.
Kushmerick, N. (2000). Wrapper induction: Efficiency and expressiveness.
Artificial Intelligence, 118(1-2), 15-68.
Kushmerick, N., Weld, D. S., & Doorenbos, R. B. (1997). Wrapper induction for information extraction. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’97) (pp. 729-737).
Lewerenz, J. (2000). Automatic generation of human-computer interac-tion in heterogeneous and dynamic environments based on concep-tual modelling.
Lieberman, H. (1995). Letizia: An agent that assists web browsing. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’95) (pp. 924-929).
Nwana, H. S., Lee, L. C. & Jennings, N. R. (1996). Coordination in software agent systems. The British Telecom Technical Journal, 14(4), 79-88.
Petrie, C. (1996). Agent-based engineering, the Web, and intelligence. IEEE Expert, 11(6), 24-29.
Rosenschein, J. (1985). Rational interaction: Cooperation among intelli-gent aintelli-gents. Stanford, CA: Standford University. (PhD Thesis).
Sahuguet, A. & Azavant, F. (1999). Building light-weight wrappers for legacy web data-sources using W4F. Proceedings of the International Con-ference on Very Large Databases (VLDB).
Sahuguet, A. & Azavant, F. (2001). Building intelligent web applications using lightweight wrappers. Data & Knowledge Engineering, 36(3), 283-316.
Selberg, E. & Etzioni, O. (1997, January/February). The metacrawler archi-tecture for resource aggregation on the Web. IEEE Expert, 8-14.
Serafini, L. & Ghidini, C. (2000). Using wrapper agents to answer queries in distributed information systems. Proceedings of the 4th International Conference on Multiagent Systems.
Sycara, K. P. (1989). Multiagent compromise via negotiation. In Distributed Artificial Intelligence (vol. II, pp. 119-138). San Mateo, CA: Morgan Kaufmann.