I write custom bots and crawlers/scrapers in Python, Ruby, NodeJS, Go. Complex fault-tolerant and distributed solutions with proxies rotation, captcha solving, forms filling, Javascript rendering, AJAX interaction, API's interaction, authentication, real users behaviour simulation, etc.
Data processing pipelines (cleansing, enrichment, validation, classification), ETL.
I write custom bots and crawlers/scrapers in Python, Ruby, NodeJS, Go. Complex fault-tolerant and distributed solutions with proxies rotation, captcha solving, forms filling, Javascript rendering, AJAX interaction, API's interaction, authentication, real users behaviour simulation, etc.
Data processing pipelines (cleansing, enrichment, validation, classification), ETL.
PostgreSQL, MongoDB, RabbitMQ, Redis, ElasticSearch, BigQuery, Redshift, Hadoop.
Backend and dashboard development in Ruby on Rails.
Email: [email protected]