Software Engineer (Big Data)
Quantcast is a leading company in advertising technology that revolutionizes how it works through AI-powered solutions. They are seeking a Software Engineer to join their Big Data Services team, focusing on building and optimizing large-scale data processing systems to support data science and engineering teams.
Responsibilities
- Contribute to the development and optimization of large-scale data workflows using technologies such as Apache Spark or similar frameworks
- Debug and resolve issues in distributed environments, including data inconsistencies and job failures
- Maintain and enhance the services that support the distributed storage and compute platform
- Assist in deploying and maintaining production systems, including CI/CD workflows
- Work to make our platform more elastic and fault-tolerant
- Provide technical input into roadmaps for the team
- Write clean, maintainable, and well-tested code
Skills
- BS in computer science or equivalent experience
- 1-3 years of professional software engineering experience (internships included)
- You must be work-authorized in the United States without the need for employer sponsorship
- This is a hybrid role based in our San Francisco. To ensure a manageable commute for in-office days, candidates must reside within a 60-mile radius of San Francisco, CA. No relocation candidates at this time
- Familiarity with data processing frameworks such as Apache Spark, Hadoop, or similar
- Familiarity with containerization tools (e.g., Docker and Kubernetes)
- Proficient in Java and/or Python programming languages
- Linux system administration/automation experience
- Strong problem-solving and debugging skills
- Organized, detail-oriented personality
- Experience with workflow orchestration tools (e.g., Airflow) is a plus
Benefits
- Performance bonus
- Equity
- Comprehensive benefits package
Company Overview