Description:
? Wizard is revolutionizing the shopping experience using generative AI and messaging technologies.
? Seeking a Senior Data Engineer to enhance data collection, storage, and analysis capabilities.
? This position is critical for strengthening data infrastructure for data-driven decision making and growth initiatives.
? Develop and maintain scalable data infrastructure for batch and real-time data processing.
? Build and optimize ETL pipelines for efficient data flow and accessibility.
? Collaborate with data scientists and cross-functional teams for accurate monitoring and analysis.
? Design backend data solutions for microservices architecture, ensuring seamless integration.
? Implement and manage integrations with third-party e-commerce platforms.
Requirements:
? 5+ years of professional experience in software development with a strong focus on data engineering.
? Bachelor’s degree in Computer Science or a related field, or equivalent practical experience.
? Proficiency in Python with experience implementing software engineering best practices.
? Strong expertise in building ETL pipelines using tools such as Apache Spark, Databricks, or Hadoop (Spark experience is required).
? Solid understanding of distributed computing and data modeling for scalable systems.
? Hands-on experience with NoSQL databases like MongoDB, Cassandra, DynamoDB, or CosmosDB.
? Proficiency in real-time stream processing systems such as Kafka, AWS Kinesis, or GCP Data Flow.
? Experience with Delta Lake, Parquet files, and cloud platforms (AWS, GCP, or Azure).
? Familiarity with caching and search technologies such as Redis, Elasticsearch, or Solr.
? Knowledge of message queuing systems like RabbitMQ, AWS SQS, or GCP Cloud Tasks.
? Advocate for Test-Driven Development (TDD) and experienced in using version control tools like GitHub or Bitbucket.
Benefits:
