- Added Claude Code MCP callout in opening section
- Featured 'Claude Code Ready' in features list
- Added dedicated MCP integration example after Quick Start
- Positions Crawailer specifically for AI agent and MCP server use cases
- Removed pepy.tech downloads badge that shows 0 for new packages
- Will re-add once we have meaningful download numbers
- Keeps PyPI version and Python support badges which work immediately
- Complete browser automation with Playwright integration
- High-level API functions: get(), get_many(), discover()
- JavaScript execution support with script parameters
- Content extraction optimized for LLM workflows
- Comprehensive test suite with 18 test files (700+ scenarios)
- Local Caddy test server for reproducible testing
- Performance benchmarking vs Katana crawler
- Complete documentation including JavaScript API guide
- PyPI-ready packaging with professional metadata
- UNIX philosophy: do web scraping exceptionally well
- Comprehensive test suite (700+ lines) for JS execution in high-level API
- Test coverage analysis and validation infrastructure
- Enhancement proposal and implementation strategy
- Mock HTTP server with realistic JavaScript scenarios
- Parallel implementation strategy using expert agents and git worktrees
Ready for test-driven implementation of JavaScript enhancements.
