Data Engineer at Ankamala Research
- Built and maintained ETL pipelines that collect, clean and store web data.
- Wrote scraping and extraction code in the company's in-house framework for sites with inconsistent page structure, and validated the output before handing it over.
- Built an internal backend API service.
Specific tools, data sources and partners are covered by a non-disclosure agreement.