Data Engineer

Full Time
Remote
Posted
Job description

Obsidian makes SaaS security simple with an innovative, data driven approach to protecting the SaaS space. The company was founded by veterans in endpoint security and is backed by Greylock, Wing, and Google Ventures. The leadership team includes innovators from AWS, Carbon Black, Cylance, and Shape Security, where they have delivered enterprise-grade products to thousands of customers.

At Obsidian, machine learning and analysis are at the core of our business. As a Data Engineer, you will be part of a highly visible, agile team within the Data Science Group working on critical problems that directly affect the company’s success. The Data Engineer role provides a unique opportunity to work across many functions of our growing business including data science, engineering, and product.

Obsidian is seeking a Data Engineer to build, maintain, monitor, and improve a real time scalable, fault tolerant, data processing pipeline. You will help productize machine learning algorithms for a cloud-based, multi-tenant SaaS product. This expert engineer will be expected to have both deep technical skills in data architecture and big data, as well as leadership and organizational skills.

Who You Are:

  • You’re an engineer who is experienced designing, implementing and supporting new data processing, data sets and systems to support various advanced analytics needs from multiple sources.
  • You enjoy solving large-scale problems and are comfortable doing incremental quality work while building brand new systems to enable future quality improvements

What You'll Do:

  • Participate in the engineering life-cycle at Obsidian, including designing distributed systems, writing production code, conducting code reviews and working alongside our infrastructure and reliability teams.
  • Work in a big data ecosystem to develop and maintain an analytics pipeline for acquisition, storage, and processing data types of interest to feed real-time artificial intelligent system behaviors.
  • Develop or implement tools to support analyst-driven machine learning analyses.
  • Support and build well-engineered data systems to support analytical needs for cloud based systems (AWS) and deliver data via APIs
  • Collaborate with the existing engineering team, data scientists, analysts and the business to understand requirements and data needs and definitions.

Required skills/experience:

  • BS/MS Computer Science or a highly quantitative discipline (MS Degree preferred)
  • Ability with the following programming languages: Scala and Python
  • Extensive experience with the following software packages: SQL, NoSQL, Apache products (Spark, Hive, Airflow, Hadoop, etc.) and graph databases
  • Familiarity with DevOps and AWS (S3, EMR, EC2 are a must)
  • Successfully delivered and maintained a major cloud service with a large number of end users.
  • Cybersecurity experience is a plus

Obsidian has offices in both the Newport Beach and Redwood City, CA area. This position is open to both locations, and potentially remote working. Please only apply if you are in the United States.

At Obsidian, we value diversity and freethinkers and are proud to be an equal opportunity employer. In compliance with federal law, all persons hired will be required to submit satisfactory proof of identity and legal authorization to work in the United States.


2s9iDf5W2N

arclintfl.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, arclintfl.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, arclintfl.com is the ideal place to find your next job.

Intrested in this job?

Related Jobs

All Related Listed jobs