Big Data Engineer jobs

Purpose of position
Data sits at the heart of the company. This role is to ensure that Awin is able to leverage the data it has access to across the group and build out reporting to ensure we are able to make better commercial decisions and provide best-in-class campaign management to support client-facing departments.
As a Data Engineer, your responsibility is to collect data from different sources, sanitize, cleanse, transform, and consolidate these collected data, make them available for further analysis, and/or publish them as a report.
You understand data, business and technical requirements. You write clean and high-quality code that is easy to understand and maintain. You clearly understand the various methodologies of data extraction, transformation and storage and successfully apply your experience and knowledge of scripting, SQL, and conceptual OLTP and/or OLAP datasets.
Within the role, you can break down requirements with clear instructions. As a member of the Data Services department, you will work with a global team of data engineers and analysts, as well as other big data engineers within the organization.

Key Tasks & accountabilities:

• Cleanse and preprocess raw text data for analysis and modelling purposes.
• Analyze text corpora, including customer support history and the company knowledge base.
• Extract actionable insights to inform project development and decision-making.
• Build and maintain data ingestion pipelines from various sources like Salesforce to the data lake.
• Ensure data quality, consistency, efficiency, and integrity during the ingestion and transformation processes.
• Assist in indexing and vectorizing text data
• Collaborate with data scientists to select and implement appropriate embedding methods.
• Work closely with data scientists and AI engineers to align data engineering efforts with machine learning requirements.
• Participate in team meetings and contribute to project planning and strategy discussions.

Education & experience:

• Bachelor or Master’s degree in data science, data engineering, or Computer Science with a focus on math and statistics / Master’s degree is preferred
• 3+ years experience as data engineer building data pipelines with Python, spark or similar
• Strong foundation in computer science principles and statistical methods.
• Strong experience with cloud technology (AWS or Azure) 
• Strong experience with the creation of data ingestion pipelines and ET processes. 
• Strong knowledge of big data tools such as Spark, Databricks and Python 
• Basic understanding of common machine learning techniques
• Familiarity with Natural language processing (NPL) concepts.
• Strong knowledge of scrum practices and agile mindset

Skills & Core competencies

• Strong Analytical and Problem-Solving Skills with attention to data quality and accuracy
• Clear Communication of technical concepts and effective collaboration across teams
• Adaptability to New Technologies and a proactive approach to learning and growth
• Team-oriented mindset, working closely with data scientists, AI engineers, and cross-functional teams
• Openness to Feedback and collective problem-solving for continuous improvement
• Team player, willing to improve yourself 

 

Established in 2000, Awin is proud of our dynamic, social, and inclusive culture.

Like all businesses, we’ve had to adapt and nurture our culture in a virtual environment. Our virtual ‘Life @ Awin’ hub brings our colleagues from across the globe together for various social activities.

Diversity & Inclusion are paramount to us, and we proudly pursue and hire diverse team members. We champion uniqueness and authenticity; this is who we are at our core. Our network of affiliate partnerships is diverse and transparent, as are the employees powering our vision to build the world’s leading open partner ecosystem. We welcome all backgrounds, identities, and experiences. If you need support at any point in the application or interview process, please let us know.

Apply now to begin the next stage of your career at a progressive company that supports both your professional and personal development.