About Company
At Career.zycto, we’re building the future of data-driven innovation. A Big Data Engineer thrives in our environment, tackling complex challenges with cutting-edge technologies. Join a collaborative team where your expertise in scalable data pipelines and distributed systems will directly impact our strategic growth and product development. We champion continuous learning and provide ample opportunities to work with petabyte-scale datasets and advanced analytics platforms. If you’re passionate about transforming raw data into actionable insights and crave an environment where your contributions are valued, Career.zycto offers the perfect blend of challenge and support for your career trajectory.
Job Description
Career.zycto is seeking a highly skilled and passionate Big Data Engineer to join our innovative team in Woodlands, Glasgow. In this pivotal role, you will be instrumental in designing, building, and maintaining our next-generation data infrastructure, enabling the extraction of critical insights from vast and complex datasets. We are looking for an individual who is not only proficient in the technical aspects of big data but also possesses a keen analytical mind and a proactive approach to problem-solving.
As a Big Data Engineer, you will be at the forefront of our data strategy, working with petabyte-scale data stores, real-time streaming platforms, and advanced analytics tools. You will collaborate closely with data scientists, machine learning engineers, and product teams to translate business requirements into robust, scalable, and efficient data solutions. Your day-to-day will involve everything from architecting new data pipelines and optimizing existing ones to ensuring data quality, security, and governance across our entire data ecosystem. This is an exciting opportunity to contribute significantly to a company that values data as its core asset and to grow your skills in a fast-paced, dynamic environment.
We operate in a hybrid model, allowing for a blend of on-site collaboration and remote work flexibility. Our Glasgow office provides a vibrant and supportive atmosphere designed to foster creativity and teamwork. If you are driven by the challenge of working with massive datasets, passionate about building resilient data systems, and eager to make a tangible impact on product development and business intelligence, we encourage you to apply. We are committed to fostering a culture of continuous learning and provide ample resources for professional development and skill enhancement. Join us and help shape the future of data at Career.zycto!
Key Responsibilities
- Design, develop, and maintain highly scalable and reliable ETL/ELT data pipelines using big data technologies (e.g., Spark, Hadoop, Kafka).
- Work with massive datasets to build and optimize data models for analytical and machine learning purposes.
- Ensure data quality, integrity, and security across all data platforms.
- Collaborate with data scientists, analysts, and product managers to understand data requirements and translate them into technical solutions.
- Monitor, troubleshoot, and optimize data infrastructure performance and resource utilization.
- Implement best practices for data governance, data lineage, and metadata management.
- Evaluate and integrate new big data tools and technologies to improve efficiency and capabilities.
- Develop and maintain documentation for data architecture, processes, and data dictionaries.
- Participate in code reviews, design discussions, and contribute to architectural decisions.
Required Skills
- Proficiency in programming languages like Python or Scala.
- Strong experience with Apache Spark for data processing.
- In-depth knowledge of distributed systems and big data frameworks (e.g., Hadoop, HDFS, YARN).
- Expertise in SQL and experience with relational and NoSQL databases.
- Experience with cloud platforms such as AWS, Azure, or GCP and their big data services.
- Familiarity with data warehousing concepts and technologies.
- Solid understanding of data modeling, ETL/ELT processes, and data pipeline orchestration (e.g., Apache Airflow).
- Version control using Git.
Preferred Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Experience with real-time data streaming technologies (e.g., Kafka, Flink).
- Knowledge of containerization technologies like Docker and Kubernetes.
- Familiarity with data governance and data security best practices.
- Experience with machine learning pipelines and MLOps principles.
- Relevant certifications in cloud big data technologies.
Perks & Benefits
- Competitive salary and performance bonuses.
- Generous paid time off and public holidays.
- Comprehensive private health and dental insurance.
- Company pension scheme with employer contributions.
- Opportunities for professional development and continuous learning.
- Flexible hybrid work model.
- Modern office environment in Glasgow with excellent transport links.
- Regular social events and team-building activities.
- Employee assistance program.
- Cycle-to-work scheme.
How to Apply
Eager to make your mark as a Big Data Engineer? We invite you to apply by clicking on the application link below. Please ensure your CV and cover letter highlight your relevant experience and passion for data. We look forward to reviewing your application!
