Data engineers maintain services, APIs, and real-time pipelines that serve data to everyone in the organization, from back end services to Snowflake to ML models. Data arrives from our app users and from third party vendors, and is transformed both in batches and in real time using services using Kubernetes, SNS, SQS, Kafka, and Airflow.Major projects:- Refactor primary real-time data pipeline to accept input data from a second, new vendor- Implement new vertically integrated CI/CD method, enabling easier and more thorough testing, significantly improved development and release speeds, and one-click deployment of long-standing or ephemeral copies of applications/infrastructure. Also includes implementation of Bazel to replace Makefiles.- Deploy product to brand new, clean slate AWS account using vertically integrated deployment method. Configure one-click deployments and rollbacks for this product in dev, UAT, production, etc.

Like in any early startup, all positions wear many hats. This position involves:- Architecture (schema, ETL flow, organization) and administration (role design, user and permissions management and automation) of the Snowflake "data lakehouse" and dbt project - Implementation of Dagster for orchestration of ETL jobs in Snowflake, Databricks, DynamoDB, and Typesense- Automate and simplify Data Science workflows so they can self serve with dbt and Dagster- Design and maintenance of DevOps infrastructure, using Pulumi to deploy AWS and Kubernetes resources- Help design and implement Dev/Stage/Prod environments across data lakehouse, Dagster, and our applications- Automate ingestion of all upstream data sources into data lakehouseMajor projects:- dbt overhaul- Snowflake role overhaul- Dagster implementation and automation of all ETL + incremental/delta loading config- Pulumi infrastructure refactor- Esri shapefile data ingestion pipeline- Real-time ELT ingestion pipeline from Kinesis to Snowflake- Snowflake ephemeral development/test environment deployment/teardown- Entity resolution pipeline, including daily metrics and testing on each new mapping- "Legacy Dagster job" implementation: automatically removes jobs from Dagster when they need to be deprecated

Major projects:- Modify "dry run" test to use dynamic SQL parsing and injection- Design security model with DBT/Snowflake so teams can customize table/row/column security- Design and lead creation of Chassis, a metadata/documentation/change management service built on top of an AWS Neptune Gremlin graph database. The service, built in TypeScript and running in Kubernetes, has a React/TypeScript front end UI.- Lead writing of job description, promotion ladder, and interview questions for Business Intelligence Engineers, a new job family at Convoy. - Gather Operational Excellence data (on-call response times, repeat alerts, PR review times, test coverage, etc.), create dashboards, and lead a bi-weekly session to share best practices, highlight improvements, and discuss inefficiencies within our data organization.- Create plan for incremental data warehouse migration that minimizes drops in productivity, gather stakeholder approval, and coordinate migration with BIE teams. Other duties:- Admin for Tableau Online- Create patches in custom fork of open source Metabase using Clojure

Data Engineers are responsible for ETL pipeline health, data warehouse latency and test coverage, data architecture best practices, and creating self-service tools for data scientists to contribute to the data warehouse. The ETL pipeline transforms real-time data coming from Apache Kafka and batch-loaded data from Fivetran and other processes. Data engineering tools: Snowflake, Airflow, dbt, AWS ECR and ECS, CircleCI, Fivetran, DockerMajor projects:- Data Warehouse schema re-architecture - Dynamic DAG generator- Dynamic SQL parser/splicer (SAMPLE and, later, "where false")- Secure HR data warehouse design- Slowly Changing Dimension builder- "Dry Run" downstream SQL testing- Metabase bulk-caching Other duties:- Data Engineering quarterly planning and OKR setting- Sprint planning and backlog management in Jira

The Data Platform Team Lead provides senior development, people management, thought leadership, and process implementation to the Data Engineering practice, which primarily focuses on data infrastructure, architecture, ETL, and automation. Project-based responsibilities include planning, assistance, and review of work done by coworkers and direct reports, pre-sales work scoping, senior-level BI development (using SQL, SSIS, SSAS, Python, PowerShell, Snowflake, Alteryx), end-to-end BI architecture design and implementation planning, and client communications.The Team Lead helps better the Data Engineering practice by documenting knowledge and implementing best practices for data warehouse design, testing, operational techniques, and client relations. This also involves reviews with direct reports for quality control.Managerial duties consist of interviewing, onboarding, and reviewing direct reports as well as assisting with project resourcing and pre-sales.

The Data Analyst is responsible for the architecture, coding, delivery, and/or maintenance of multiple reporting systems. This involves jobs at every step of the data warehouse creation process: gathering requirements from clients, designing the data model, writing the SQL/creating the SSIS packages to facilitate the ETL, developing a tabular cube in SSAS, and building dashboards in Power Pivot/Power BI, Tableau, SSRS, and Excel. Additionally, the Data Analyst regularly communicates with clients to provide project updates and clarify business requirements, as well as offers advice on BI strategies, technologies, and implementation. Most work is done using Agile methodology. Other duties include:• Research, testing, support, ETL design, and reporting for various consulting projects• Leading the design/implementation of a marketing strategy for Decisive Data• Using Google Analytics, T-SQL, and Tableau to track digital marketing efforts, website performance and social media• Assembling and publishing content for the WordPress blog• Updating social media accounts

Bill4Time's Marketing Coordinator is in charge of managing all marketing/advertising initiatives. This entails communications with partners and making decisions regarding copywriting and media buying. Responsibilities include:• Writing blog posts (in WordPress), newsletters, press releases, articles, etc.• Tracking/revising Google AdWords campaigns• Designing/executing customer surveys and market research• Analyzing the value of marketing campaigns via Google Analytics• Updating Facebook and Twitter accounts