Ensuring an uninterrupted flow of data from the various sources by crawling the web
Extracting & managing large volumes of structured and unstructured data, with the ability to parse data into standardized format for ingestion into data sources
Actively participate in troubleshooting, debugging & maintaining the broken crawlers
Scraping difficult websites by deploying anti-blocking and anti-captcha tools
Strong data analysis skills working with data quality, data consolidation and data wrangling
Solid understanding of Data structures and Algorithms