Browse
···
Log in / Register

Data Engineer (PySpark) - Leading UAE Bank, Cloudera Data Platform Expert

Negotiable Salary

GSSTech Group

Dubai - United Arab Emirates

Favourites
Share

Description

Job Title: Data Engineer (PySpark) ________________________________________ About the Role We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that ensure high data quality and availability across the organization. This role requires a strong background in big data ecosystems, cloud-native tools, and advanced data processing techniques. The ideal candidate has hands-on experience with data ingestion, transformation, and optimization on the Cloudera Data Platform, along with a proven track record of implementing data engineering best practices. You will work closely with other data engineers to build solutions that drive impactful business insights. Responsibilities Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy. Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP. Data Transformation and Processing: Use PySpark to process, cleanse, and transform large datasets into meaningful formats that support analytical needs and business requirements. Performance Optimization: Conduct performance tuning of PySpark code and Cloudera components, optimizing resource utilization and reducing runtime of ETL processes. Data Quality and Validation: Implement data quality checks, monitoring, and validation routines to ensure data accuracy and reliability throughout the pipeline. Automation and Orchestration: Automate data workflows using tools like Apache Oozie, Airflow, or similar orchestration tools within the Cloudera ecosystem. Monitoring and Maintenance: Monitor pipeline performance, troubleshoot issues, and perform routine maintenance on the Cloudera Data Platform and associated data processes. Collaboration: Work closely with other data engineers, analysts, product managers, and other stakeholders to understand data requirements and support various data-driven initiatives. Documentation: Maintain thorough documentation of data engineering processes, code, and pipeline configurations.  Qualifications  Education and Experience Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field. 3+ years of experience as a Data Engineer, with a strong focus on PySpark and the Cloudera Data Platform.  Technical Skills PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques. Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase. Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala). Big Data Technologies: Familiarity with Hadoop, Kafka, and other distributed computing tools. Orchestration and Scheduling: Experience with Apache Oozie, Airflow, or similar orchestration frameworks. Scripting and Automation: Strong scripting skills in Linux.  Soft Skills Strong analytical and problem-solving skills. Excellent verbal and written communication abilities. Ability to work independently and collaboratively in a team environment. Attention to detail and commitment to data quality.


Location
Dubai - United Arab Emirates
Show Map

Workable
3,441listings

You may also like

Workable
SAP SAC(Analytics Cloud )-3 month contract could be extended
Dubai - United Arab Emirates
About Müller's Solutions: Müller's Solutions is an industry-leading SAP consulting firm dedicated to delivering innovative solutions that empower businesses to maximize their SAP investments. Our team of experienced professionals is committed to providing tailored services that drive efficiency and effectiveness in data management and analytics. Job Overview: We are seeking a skilled SAP Analytics Cloud (SAC) Consultant for a 3-month contract that could be extended based on project needs. In this role, you will be responsible for implementing and supporting SAP Analytics Cloud solutions to enhance reporting, visualization, and data analysis capabilities for our clients. You will collaborate closely with business stakeholders to gather requirements and create meaningful insights. Requirements Requirements: Bachelor's degree in Computer Science, Data Science, Information Systems, or a relevant field. A minimum of 3 years of experience working with SAP Analytics Cloud (SAC) or similar BI tools. Hands-on experience with SAC for data modeling, storytelling, and dashboard creation. Experience in connecting SAC with various SAP and non-SAP data sources. Demonstrated experience in Integrated Financial Planning (Standard). Strong understanding of best practices for visualization, reporting, and analytics. Experience integrating SAP Analytics Cloud with SAP BW, SAP HANA, or other data sources. Knowledge of data preparation, ETL processes, and data transformation best practices. Excellent analytical and problem-solving skills to evaluate business requirements and provide effective solutions. Strong communication skills to effectively interface with clients and gather requirements. Ability to work independently and collaboratively in a fast-paced environment. SAC certification is a plus but not mandatory.
Negotiable Salary
Workable
Technology Engineer - MongoDB (For Banking Client)
Dubai - United Arab Emirates
We are seeking a Technology Engineer with expertise in MongoDB to join our team and support innovative technology projects for our banking client. This role offers an exciting opportunity to work on cutting-edge initiatives, collaborate with skilled professionals, and contribute to impactful solutions in the financial domain. About the Role As a MongoDB Database Engineer, you will play a key role in supporting technology projects across various banking domains. You will work on multiple projects simultaneously, tackling complex challenges while maintaining a high level of performance under pressure. This role may occasionally require out-of-hours and weekend work, making it ideal for professionals who thrive in dynamic and challenging environments. Your expertise will contribute directly to the success of mission-critical projects, ensuring the seamless performance, scalability, and reliability of MongoDB databases that support the banking industry. What We’re Looking For 📚 Education: Bachelor’s degree or higher in Computer Science (Essential) Relevant certifications (Desirable) 💼 Experience: Minimum 4+ years of experience in large organizations (Essential) Background in banking or financial services (Desirable) 🛠️ Knowledge and Skills: Must-Have Expertise: Comprehensive knowledge of MongoDB, including: Database administration, architecture, and internals ReplicaSet clusters and Sharding Ops Manager and backup/restore mechanisms Patching/upgrades and performance tuning Database migrations and Mongo Query Language (MQL) Strong proficiency with Unix/Linux operating systems Hands-on experience in Agile working practices Nice-to-Have Skills: Familiarity with automation tools like Ansible, Jenkins, and Terraform Proficiency in scripting languages (e.g., Bash, Python) Experience with other database systems Why Join Us? Work on impactful projects that shape the future of banking technology Collaborate with a team of experienced professionals in a supportive environment Opportunities for professional growth and skill enhancement Be part of an organization that values innovation, excellence, and teamwork
Negotiable Salary
Dubizzle
Power BI Specialist AI-Driven – Data Management for Leading Real Estate Brokerage (Dubai)
448P+VM4 - Palm Jumeirah Rd - The Palm Jumeirah - Dubai - United Arab Emirates
We're Hiring: Power BI Specialist / Data Analyst (AI-Driven Data Management Focus – Hybrid Work) Location: Dubai (Hybrid – Work from home & office) Job Type: Full-Time Are you passionate about transforming raw real estate data into actionable insights? Do you excel at leveraging Power BI, AI tools, and advanced analytics to uncover market trends, forecast challenges, and drive brokerage decisions in a dynamic environment? We’re seeking a Power BI Specialist / Data Analyst to manage and analyze data from Dubai's real estate market, including property listings, sales transactions, rental yields, investor behaviors, and market research from sources like Bayut and Property Finder. This role is crucial for interpreting data, identifying trends such as the 8-12% growth in prime residential segments and off-plan booms, and addressing challenges like potential supply surges (up to 210,000 units in 2025-2026) and price moderations, while embracing future trends in sustainable developments, PropTech integrations, and smart home analytics. Advanced Power BI expertise and AI-driven tools are essential for handling large datasets and providing predictive insights in this thriving yet volatile market. What You’ll Do: • Analyze large datasets from real estate sources (e.g., sales volumes, rental trends, investor surveys) to spot patterns like rising demand in luxury and affordable segments amid limited supply in 2025. • Clean, validate, and structure data using AI-powered tools for automation, error detection, and enrichment to ensure accuracy in forecasting challenges like delivery peaks and potential 5-10% price corrections. • Build advanced Power BI dashboards with AI features (e.g., anomaly detection, key influencers, natural language querying) for interactive reporting on market trends, such as off-plan investments and sustainable property growth. • Generate visual summaries, predictive trend analyses, and actionable recommendations using AI for scenario modeling (e.g., impacts of global interest rates on borrowing and market stability). • Collaborate with brokerage and strategy teams to align data needs with future PropTech trends, like AI valuations and smart city integrations. • Assist in quality checks, data integrity, and AI-automated workflows throughout the analysis process to support resilient decision-making in a market projected for stable returns through 2025. What We’re Looking For: • Proven experience as a Power BI Specialist or Data Analyst (preferably in real estate, PropTech, or market analytics environments). • Mastery of Power BI for AI-enhanced visualization, data modeling (DAX, Power Query), and integrations; advanced Excel skills are a must – pivot tables, nested formulas, data visualization, error tracing, VBA is a plus. • Expertise in AI-driven tools for data management, cleaning, and analysis, such as Azure AI for predictive modeling, Python/R in Power BI for custom ML, anomaly detection tools for market shifts, and PropTech-specific platforms (e.g., for valuation and trend tracking) to address Dubai's challenges like supply surges and interest rate impacts. • Strong analytical thinking, attention to detail, and knowledge of Dubai's real estate ecosystem, including current trends (e.g., strong Q2 2025 growth, luxury boom, affordable housing focus) and future challenges (e.g., 2026 delivery peaks, moderation in price growth). • Ability to work with large datasets, draw insights on investor trends (e.g., foreign demand from global sources), and forecast opportunities in sustainable and tech-integrated properties. • Comfortable working independently in a hybrid setup (home and office); experience with SPSS, Tableau, or GIS tools for location-based real estate analytics is a plus. What We Offer: • Flexible hybrid working model. • Exposure to diverse real estate projects in Dubai's booming market. • Opportunity to influence brokerage decisions with AI-driven, data-backed insights. • Collaborative and supportive team environment. • Room to grow within a dynamic, agile brokerage firm. Ready to apply? Send your CV and a brief note highlighting your Power BI and AI tool experience. Note: Only apply if you have advanced Power BI and Excel skills. Shortlisted candidates will sit for a skills assessment in Power BI and data analysis. or send What'sapp +971551045207 for google meet to fix an appointment for online interview.
AED 12,000-19,999/month
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.