Bestjobs Malaysia

Don't miss any news or updates from BestJobs

Not now Allow

Data Engineer

$ 8,000.00 monthly Petaling, Selangor 22 March

VV Consulting Group

  • Description

  • What you’ll be doing:
    In this role, you’ll be working as an Analytics Engineer within Analytics Center of Excellence on Experian’s internal Cloud Platform. You’ll be managing data at scale and working on key initiatives such as Data Productizations where we employ different big data technologies and back/front ends to build solutions for our clients.

    More about you:
    • Experience in data warehouse technologies, data modeling and ETL development
    • Experience in a high-performing, large-scale technology driven environment
    • Exposure in creating/maintaining Data pipeline (Apache Spark or similar) and workflow tools (Airflow or similar) for both Realtime and batch use cases. Cloud experience (Azure is preferred)
    • Basic understanding of ML, Deep learning, Wrappers and APIs
    • Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O (Mandatory)
    • Strong coding skill in SQL and (Python or Java or Scala)
    • Exposure to Database architecture using RDBMS or NoSQL: Views/Tables, Disk usage and relational diagram
    • Excellent communication, interpersonal skills, and proven project management skills.
    • Management of Hadoop cluster, with all included services, and ability to solve any ongoing issues with operating the cluster
    • Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming (Good to have)
    • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
    • Experience with integration of data from multiple data sources
    • Knowledge of various ETL techniques and frameworks, such as Flume
    • Experience with various messaging systems, such as Kafka or RabbitMQ
    • Good understanding of Lambda Architecture, along with its advantages and drawbacks
    • Experience with Cloudera/MapR/Hortonworks
  • Number of vacancies: 1
  • Requirements

  • Minumun level of education: Bachelor´s Degree
  • Years of experience: 5
  • Language(s): English
  • Driver's license: Car
  • Availability for travel: Yes
  • Availability for change of residence: Yes

Similar ads

Full Time - Permanent contract - $ 4,000.00 monthly

4 June

Full Time - Permanent contract - $ 4,000.00 monthly

10 May

Full Time - Permanent contract - $ 3,000.00 monthly

31 March

Ad summary

  • Data Engineer

  • Recruiter

    VV Consulting Group

  • Location

    Petaling, Selangor

  • Work type

    Full Time

  • Type of contract

    Permanent contract

  • Salary

    $ 8,000.00 monthly

  • Apply now

Related search