Senior Data Engineer

Job title: Senior Data Engineer

Company: Flipkart

Job description: About Flipkart

The Flipkart Group is one of India’s leading digital commerce entities and includes group companies Flipkart, Myntra, and PhonePe. Started in 2007, Flipkart has enabled millions of consumers, sellers, merchants and small businesses to be a part of India’s e-commerce revolution. With a registered customer base of over 200 million, offering over 150 million products across 120+ categories. Our efforts to democratize e-commerce in India, driving access and affordability, delight customers, create lakhs of jobs in the ecosystem and empower generations of entrepreneurs and MSMEs has driven us to innovate on many industry firsts. Flipkart is known for pioneering services such as Cash on Delivery, No Cost EMI and easy returns – customer-centric innovations that have made online shopping more accessible and affordable for millions of Indians.

Driven by the passion of ‘Flipsters’ and our core values of Audacity to Win, Bias for Action and Customer First, with Integrity – Flipkart’s work policies reflect the company’s efforts to create a progressive work environment that drives inclusion and innovation and encourages work-life balance. Ranked at #1 in LinkedIn’s ‘Top Companies to Work For in 2019’, among the ‘100 Best Companies for Women by Avtar and chosen among the Top 3 Most Desirable new-Age Recruiters by Dare2Compete, Flipkart is the ideal place to start and achieve great heights in your career. Job Description :

About Role

Data engineers to build data analytics solutions that will address increasingly complex business questions. Data Engineer will be a hands-on person responsible for designing, prototyping and implementing data products that support a wide variety of data processing, data science and analytics needs. Data Engineers work closely with data scientists, product managers, data platform team to understand the functional data requirements and leverage the underlying tech stack to come up with scalable, robust data applications which can crunch terabytes of data in real-time. Data products and applications you build will enable data-driven decision making across business, analytics and operations.

What you ll do:

You should have expertise in designing, implementing, and operating stable, scalable, solutions to flow data from production systems into analytical data platform (big data tech stack + MPP) and into end-user facing applications for both real-time and batch use cases

The ability to do deep problem solving and build elegant, maintainable solutions to complex problems. Designing platforms as consumable data services across the organization using Big Data tech stack. Do high-level design independently; Functional modeling, break-down of a module

Influence product requirements & operational plans. Instill best practices for development and champion their adoption, while working with product managers to estimate and plan projects in agile development framework.

Architectural & Design Choices, Deep knowledge on one or more tech stacks, identify alternative tech choices and trade-offs. Build and execute data modeling projects across multiple tech stacks i.e. big data, MPP, OLAP using agile development techniques

Strong problem-Solving skills, Identify feasible alternatives and freeze on the optimal choice of the design approach. Strong engineering mindset – build automated monitoring, alerting, self-healing (restart ability/graceful failures) features while building the consumption pipelines.

Challenge status quo and propose innovative ways to process, model, consume data when it comes to tech stack choices or design principles. Translate business requirements into technical specification (fact/dimension/filters/derivations/aggregations)

Lead by example, mentor and guide team members on everything from structured problem solving to development of best practices

An ideal candidate will have excellent communication skills to be able to work with engineering, product and business owners to develop and define key business questions and to build data sets that answer those questions. you should bring your passion for working with huge data sets and bringing datasets together to answer business questions and drive change

What you ll need:

5-7 years experience with a Bachelor’s Degree in Computer Science, Engineering, Technology or related field required. 3 to 4 years of relevant software development experience with sound skills in database modeling (relational, multi-dimensional) & optimization and data architecture – databases e.g. Vertica

In-depth understanding of streaming technologies like Kafka, Spark Streaming. Proficiency in one of the programming languages preferably Java, Scala or Python. Good knowledge of Agile, SDLC/CICD practices and tools with good understanding of distributed systems

Experience with Enterprise Business Intelligence Platform/Data platform sizing, tuning, optimization and system landscape integration in large-scale, enterprise deployments.
Must have proven experience with Hadoop, Mapreduce, Hive, Spark, Scala programming. Must have in-depth knowledge of performance tuning/optimizing data processing jobs, debugging time-consuming jobs.

Proven experience in the development of conceptual, logical, and physical data models for Hadoop, relational, EDW (enterprise data warehouse) and OLAP database solutions.

Experience working extensively in multi-petabyte DW environments. Experience in engineering large-scale systems in a product environment Posted On :

About Role

Data engineers to build data analytics solutions that will address increasingly complex business questions. Data Engineer will be a hands-on person responsible for designing, prototyping and implementing data products that support a wide variety of data processing, data science and analytics needs. Data Engineers work closely with data scientists, product managers, data platform team to understand the functional data requirements and leverage the underlying tech stack to come up with scalable, robust data applications which can crunch terabytes of data in real-time. Data products and applications you build will enable data-driven decision making across business, analytics and operations.

What you ll do:

You should have expertise in designing, implementing, and operating stable, scalable, solutions to flow data from production systems into analytical data platform (big data tech stack + MPP) and into end-user facing applications for both real-time and batch use cases

The ability to do deep problem solving and build elegant, maintainable solutions to complex problems. Designing platforms as consumable data services across the organization using Big Data tech stack. Do high-level design independently; Functional modeling, break-down of a module

Influence product requirements & operational plans. Instill best practices for development and champion their adoption, while working with product managers to estimate and plan projects in agile development framework.

,

Other details

Expected salary:

Location: Bangalore, Karnataka

Job date: Fri, 04 Sep 2020 22:35:04 GMT

Apply for the job now!