4 Commits

Author SHA1 Message Date
Crawailer Developer
d35dcbb494 Complete Phase 3: High-level API JavaScript integration
- Enhanced get() function with script, script_before, script_after parameters
- Enhanced get_many() function with script parameter (str or List[str])
- Enhanced discover() function with script and content_script parameters
- Updated ContentExtractor to populate script fields from page_data
- Maintained 100% backward compatibility
- Added comprehensive parameter validation and error handling
- Implemented script parameter alias support (script -> script_before)
- Added smart script distribution for multi-URL operations
- Enabled two-stage JavaScript execution for discovery workflow

All API functions now support JavaScript execution while preserving
existing functionality. The enhancement provides intuitive, optional
JavaScript capabilities that integrate seamlessly with the browser
automation layer.
2025-09-14 21:47:56 -06:00
Crawailer Developer
e544086e6b Complete Phase 2: Browser JavaScript integration with script_before/script_after support 2025-09-14 21:37:13 -06:00
Crawailer Developer
05df964ce1 Add JavaScript execution fields to WebContent dataclass
- Add script_result (Optional[Any]) field for storing JS execution results
- Add script_error (Optional[str]) field for storing JS execution errors
- Add has_script_result and has_script_error convenience properties
- Maintain 100% backward compatibility with existing code
- Support JSON serialization for all data types
- Pass all required TestWebContentJavaScriptFields tests

This enhancement enables the WebContent dataclass to store JavaScript
execution results and errors as part of the content extraction process,
providing a foundation for the enhanced browser automation API.
2025-09-14 21:28:01 -06:00
Crawailer Developer
7634f9fc32 Initial commit: JavaScript API enhancement preparation
- Comprehensive test suite (700+ lines) for JS execution in high-level API
- Test coverage analysis and validation infrastructure
- Enhancement proposal and implementation strategy
- Mock HTTP server with realistic JavaScript scenarios
- Parallel implementation strategy using expert agents and git worktrees

Ready for test-driven implementation of JavaScript enhancements.
2025-09-14 21:22:30 -06:00