Senior Data Engineer
Bedrock Analytics
This job is no longer accepting applications
See open jobs at Bedrock Analytics.See open jobs similar to "Senior Data Engineer" Cervin Ventures.Company Description
Bedrock Analytics transforms syndicated and retail data into dynamic selling stories for CPG sales managers. Our software provides data-based insights to help increase product sales, maintain retail presence, and optimize categories. The platform utilizes machine learning to deliver faster, smarter recommendations for a broad range of customers, from small natural food companies to multinational conglomerates. Bedrock Analytics is a venture-backed technology company based in the San Francisco Bay Area.
Job Description
We are looking for a Principal level Software Engineer to join our team in Oakland, CA. You will lead work on our core application, primarily on the backend and Data pipeline. The backend delivers RESTful APIs to our web application, and the pipeline collects, stores, processes, and analyzes huge and diverse data sets. You will be responsible for expanding our data storage and pipelines, as well as optimizing data flow and quality, while injecting machine learning capabilities into the analytics. You will also be responsible for incremental features in the API, which delivers this data to Users. The ideal candidate will be a master of data formats, data pipelines, and APIs, and enjoy optimizing systems as well as building new subsystems from scratch. You will be part of our multi time zone team of software developers and live in a dev-ops culture. You must be self-directed and comfortable with a mix of building new systems, while also improving existing systems. On any given day, you could be choosing optimal solutions, designing, building, maintaining, quality controlling, and monitoring an integrated solution to ingest, enrich, and serve the data for use by multiple applications.
Responsibilities
- Architect, Design, implement and maintain data components – extraction, conversion, ingestion, storage, distributed processing, analytics, ML
- Participating in ongoing Devops (via Oncall rotation), Integrating Cloud (AWS/Azure) tools and frameworks required
- Build APIs that provide actionable insights into key metrics
- Work with stakeholders including the Executives, Product Managers, Data Scientists, Analysts, and Customers to assist with data-related technical issues and support
- Keep our data secure across customer, corporate, and regional boundaries
- Work on the full data lifecycle – including governance, and retention policies
- Identify, and implement process improvements
Qualifications
- Principal level skill in Python & Java. Play Framework, and Pandas are a bonus.
- Substantial Experience building data pipelines and architectures – including transformation, data structures, metadata, lineage, dependency, root cause analysis and workload management
- Principal level SQL/Data skills, and comfort with various other data store – including Blobs, Key Value stores, Columnar databases, Streams, and unstructured datasets in the cloud
- Comfortable with AWS and/or Azure cloud services and devops
- Comfortable with Kubernetes, Docker, and CI Pipelines
- Team based approach, and good organizational skills
- A Bachelors or Master's degree in Computer Science, Engineering, Statistics or similar
This job is no longer accepting applications
See open jobs at Bedrock Analytics.See open jobs similar to "Senior Data Engineer" Cervin Ventures.