Web Scrapper

Availability:

Airbyte Cloud Airbyte OSS PyAirbyte

Support Level:

Marketplace

Connector Version:

0.0.4(Last updated a day ago)

Web Scrapper connector enables data synchronization from Web Scrapper source to various data destination. It gives information about sitemaps, users, scraping jobs etc.

Configuration

Input	Type	Description	Default Value
api_token	string	API Token. API token to use. Find it at https://cloud.webscraper.io/api

Streams

Stream Name	Primary Key	Pagination	Supports Full Sync	Supports Incremental
sitemap_list	id	DefaultPaginator	✅	❌
sitemap_detail	id	DefaultPaginator	✅	❌
users		No pagination	✅	❌
scraping_jobs	id	DefaultPaginator	✅	❌
scraping_job_data_quality		No pagination	✅	❌

Changelog

Expand to review

Version	Date	Pull Request	Subject
0.0.4	2024-12-12	49393	Update dependencies
0.0.3	2024-12-11	49115	Starting with this version, the Docker image is now rootless. Please note that this and future versions will not be compatible with Airbyte versions earlier than 0.64
0.0.2	2024-11-04	48269	Update dependencies
0.0.1	2024-10-29		Initial release by @bishalbera via Connector Builder