Webbots, spiders, and screen scrapers a guide to developing internet agents with PHP/CURL

Saved in:
Bibliographic Details
Main Author Schrenk, Michael
Format eBook Book
LanguageEnglish
Published San Francisco No Starch Press, Inc 2007
No Starch Press
Subjects
Intelligent agents (Computer software)
Internet programming
Internet searching
Web search engines
Online AccessGet full text

Cover

Table of Contents:
  • Webbots, spiders, and screen scrapers: a guide to developing internet agents with PHP/CURL -- ACKNOWLEDGMENTS -- BRIEF CONTENTS -- CONTENTS IN DETAIL -- INTRODUCTION -- PART I: FUNDAMENTAL CONCEPTS AND TECHNIQUES -- 1. WHAT'S IN IT FOR YOU? -- 2. IDEAS FOR WEBBOT PROJECTS -- 3. DOWNLOADING WEB PAGES -- 4. PARSING TECHNIQUES -- 5. AUTOMATING FORM SUBMISSION -- 6. MANAGING LARGE AMOUNTS OF DATA -- PART II: PROJECTS -- 7. PRICE-MONITORING WEBBOTS -- 8. IMAGE-CAPTURING WEBBOTS -- 9. LINK-VERIFICATION WEBBOTS -- 10. ANONYMOUS BROWSING WEBBOTS -- 11. SEARCH-RANKING WEBBOTS -- 12. AGGREGATION WEBBOTS -- 13. FTP WEBBOTS -- 14. NNTP NEWS WEBBOTS -- 15. WEBBOTS THAT READ EMAIL -- 16. WEBBOTS THAT SEND EMAIL -- 17. CONVERTING A WEBSITE INTO A FUNCTION -- PART III: ADVANCED TECHNICAL CONSIDERATIONS -- 18. SPIDERS -- 19. PROCUREMENT WEBBOTS AND SNIPERS -- 20. WEBBOTS AND CRYPTOGRAPHY -- 21. AUTHENTICATION -- 22. ADVANCED COOKIE MANAGEMENT -- 23. SCHEDULING WEBBOTS AND SPIDERS -- PART IV: LARGER CONSIDERATIONS -- 24. DESIGNING STEALTHY WEBBOTS AND SPIDERS -- 25. WRITING FAULT-TOLERANT WEBBOTS -- 26. DESIGNING WEBBOT-FRIENDLY WEBSITES -- 27. KILLING SPIDERS -- 28. KEEPING WEBBOTS OUT OF TROUBLE -- A. PHP/CURL REFERENCE -- B. STATUS CODES -- C. SMS EMAIL ADDRESSES -- INDEX.