IntelliPro
Get AI-powered advice on this job and more exclusive features.
This range is provided by IntelliPro. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Base pay range $125,000.00/yr - $221,000.00/yr
Direct message the job poster from IntelliPro
Job Title:
Senior Software Engineer, Web
Position Type:
Full-Time / Permanent
Location:
Mountain View, California, United States
Salary Range:
$125,000 - $221,000 USD + Bonus + options + Comprehensive Benefits
Job ID#:
159840
About the Role
As a Software Engineer-Web, you will play a pivotal role in building and optimizing our data acquisition infrastructure, ensuring the seamless collection and processing of web data to support critical business needs. You will tackle complex technical challenges in web crawling, enhance the performance of large-scale distributed systems, and contribute to the development of innovative solutions that drive our data-driven decision-making processes. If you are passionate about web technologies, data extraction, and system optimization, this is the perfect opportunity to make a significant impact.
Responsibilities
Design, develop, and maintain distributed web crawler systems, ensuring efficient data scheduling, scraping, parsing, and storage.
Collect and process data from the internet and partner sources in compliance with website policies and legal regulations.
Optimize crawler performance to handle large-scale data extraction with high efficiency and reliability.
Solve complex technical challenges related to web crawling, including anti-crawling mechanisms, dynamic content rendering, and data quality assurance.
Collaborate with cross-functional teams, including data scientists, backend engineers, and product managers, to meet diverse business data requirements.
Stay updated with the latest web technologies and crawling frameworks to continuously improve system capabilities.
Requirements
Bachelor’s degree or higher in Computer Science, Engineering, or a related field, with at least 2 years of experience in web crawling and data collection.
Proficiency in mainstream web scraping technologies and frameworks/tools such as Scrapy, Selenium, and Puppeteer.
Strong coding skills in at least one programming language, such as Python, Java, Go, or C++.
Experience with distributed systems, data pipelines, and storage solutions is a plus.
Strong problem-solving skills, attention to detail, and the ability to work independently or as part of a team.
Familiarity with frontend development and dynamic content rendering techniques is preferred.
About Us:
Founded in 2009, IntelliPro stands as a global leader in talent acquisition and HR solutions. Our commitment to delivering unparalleled service to clients, fostering employee growth, and building enduring partnerships sets us apart. With a dynamic presence in the USA, China, Canada, Singapore, Philippines, UK, India, Netherlands, and Germany, we continue to lead the way in global talent solutions.
IntelliPro is proud to be an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We also ensure that all applicants have access to accommodations throughout the hiring process. Learn more at https://intelliprogroup.com
Compensation:
The compensation offered will depend on various factors, including location, experience, education, and job-related skills. This role includes a competitive base salary, bonus, equity, and a comprehensive benefits package, subject to eligibility.
Seniority level Seniority level: Mid-Senior level
Employment type Employment type: Full-time
Job function Job function: Information Technology
Industries: Software Development
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
This range is provided by IntelliPro. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Base pay range $125,000.00/yr - $221,000.00/yr
Direct message the job poster from IntelliPro
Job Title:
Senior Software Engineer, Web
Position Type:
Full-Time / Permanent
Location:
Mountain View, California, United States
Salary Range:
$125,000 - $221,000 USD + Bonus + options + Comprehensive Benefits
Job ID#:
159840
About the Role
As a Software Engineer-Web, you will play a pivotal role in building and optimizing our data acquisition infrastructure, ensuring the seamless collection and processing of web data to support critical business needs. You will tackle complex technical challenges in web crawling, enhance the performance of large-scale distributed systems, and contribute to the development of innovative solutions that drive our data-driven decision-making processes. If you are passionate about web technologies, data extraction, and system optimization, this is the perfect opportunity to make a significant impact.
Responsibilities
Design, develop, and maintain distributed web crawler systems, ensuring efficient data scheduling, scraping, parsing, and storage.
Collect and process data from the internet and partner sources in compliance with website policies and legal regulations.
Optimize crawler performance to handle large-scale data extraction with high efficiency and reliability.
Solve complex technical challenges related to web crawling, including anti-crawling mechanisms, dynamic content rendering, and data quality assurance.
Collaborate with cross-functional teams, including data scientists, backend engineers, and product managers, to meet diverse business data requirements.
Stay updated with the latest web technologies and crawling frameworks to continuously improve system capabilities.
Requirements
Bachelor’s degree or higher in Computer Science, Engineering, or a related field, with at least 2 years of experience in web crawling and data collection.
Proficiency in mainstream web scraping technologies and frameworks/tools such as Scrapy, Selenium, and Puppeteer.
Strong coding skills in at least one programming language, such as Python, Java, Go, or C++.
Experience with distributed systems, data pipelines, and storage solutions is a plus.
Strong problem-solving skills, attention to detail, and the ability to work independently or as part of a team.
Familiarity with frontend development and dynamic content rendering techniques is preferred.
About Us:
Founded in 2009, IntelliPro stands as a global leader in talent acquisition and HR solutions. Our commitment to delivering unparalleled service to clients, fostering employee growth, and building enduring partnerships sets us apart. With a dynamic presence in the USA, China, Canada, Singapore, Philippines, UK, India, Netherlands, and Germany, we continue to lead the way in global talent solutions.
IntelliPro is proud to be an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We also ensure that all applicants have access to accommodations throughout the hiring process. Learn more at https://intelliprogroup.com
Compensation:
The compensation offered will depend on various factors, including location, experience, education, and job-related skills. This role includes a competitive base salary, bonus, equity, and a comprehensive benefits package, subject to eligibility.
Seniority level Seniority level: Mid-Senior level
Employment type Employment type: Full-time
Job function Job function: Information Technology
Industries: Software Development
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr