Full Time
50000
40
Oct 16, 2024
Role Overview:
We are seeking an experienced Python Developer with expertise in Playwright, Django, and Selenium. This role focuses on developing and maintaining our web scraping tools, optimizing performance, and ensuring compliance with ethical scraping practices. You’ll work closely with a small, dynamic team to build scalable scraping solutions that align with our business values.
Key Responsibilities:
1. Design, develop, and maintain automated web scraping tools primarily using Playwright and asyncio.
2. Integrate scraping functionalities with backend frameworks, particularly Django.
3. Implement web scraping tasks using Playwright where necessary.
4. Optimize and ensure the scalability of scraping solutions for performance and speed.
5. Collaborate with the team to ensure compliance with ethical standards for scraping and data use.
6. Monitor and troubleshoot performance issues related to scraping workflows.
7. Stay updated on industry best practices and contribute to refining our ethical scraping protocols.
8. Participate in code reviews, testing, and bug fixing for improved code quality.
Qualifications:
3+ years of Python development experience, with a focus on web scraping.
1. Expert knowledge of Playwright is essential, with experience in developing complex scraping scripts.
2. Experience with Django for backend development.
3. Working knowledge of Selenium and its applications.
4. Strong familiarity with asyncio for handling asynchronous tasks.
5. Strong understanding of web protocols, data extraction, and browser automation.
6. Experience with RESTful APIs and integrating scraped data into databases or other applications.
7. Ability to write clean, efficient, and well-documented code.
8. Familiarity with ethical data scraping practices and compliance.
Nice to Have:
1. Experience working with cloud platforms (AWS, GCP, etc.) for deploying scraping solutions.
2. Familiarity with DevOps and CI/CD pipelines.
3. nderstanding of frontend development for better integration with backend tools.
4. Previous experience in building and scaling scraping infrastructure.
What We Offer:
Competitive salary.
Flexible working hours and a fully remote position.
Opportunity to work with cutting-edge technologies.
A collaborative and innovative team environment.
Emphasis on work-life balance and professional development.