- Add CDX indexing of warc files ( golang implementations 1, 2).
- Add the ability to search using cdx
- Add the ability to capture url from UI
- spawning (headless or not) browser and keep it open.
- Impove warc records implementation following standards
- Add request Record
- Add WARC-Concurrent-To to responces
- Add WARC-IP-Address fields
- Add DNS Record
- been able to control multiple browsers with different profiles rod manager
- Capture list of urls from file or stdin
- Provive http proxy for other tools to use
- Add configuration to tweak browser behaviour
- default or custom browser profiles
- customize devices/evading fingerprint
- use proxies
- run custom scripts for specified urls (url regex)
- consider different implementation [rod], playwright, chromedp