Job vacancy Pyspark Lead

Michael Page Recruitment Agency
32/225 George St, 2000, Sydney
  +61 2 8292 2000

View all 203 Jobs
Job Type
Job Status
Full Time
13 April, 2021
Job Title

Pyspark Lead

Job Location
Job Presentation

Our client is a large scale multi-national corporation that provides IT, Consulting & Business Services.

  • Prepare test strategies, formal test plans to ensure the delivery of data related projects.
  • Provide input to design and development and testing discussions
  • Writing test data scripts, based on requirements and mapping artefacts.
  • Execution of data scripts and detailed analysis on these execution scripts.
  • Work closely with the developers and Journey experts to clarify requirements and manage defects
  • Defines and tracks quality assurance metrics such as defects, defect counts, test results and test status.
  • Documents all problems and assists in their resolution.
  • Prepare Test summary report and seek approvals

  • Capable of writing queries/code in Python, Spark and PL/SQL
  • Source their own Test Data - using their Hadoop skills to effectively read large (100's of TB) data sets and prepare the test data sets as per the requirements
  • Develop and execute test cases - it would be good to know what tools they have used
  • Experience in defining the test approach/strategy - and overseen the implementation of said approach (desirable)
  • Experience in Data Remediation - not only tested and found defects, but repaired them (data cleansing)
  • Experience in Banking Data (desirable)
  • Experience in building and producing testing 'traceability matrices' - ensuring specific requirements are tested accordingly
  • Good understanding of Data warehousing concepts (relational database concepts - Change data capture, Data modelling etc)
  • Experience in Data quality projects (desirable)
  • Secure a permanent position with a multi-national, leading edge company
  • Rare opportunity to join a large successful project team
  • Competitive salary dependant on skills & experiences
  • Remote working flexibility
  • Relocation allowances available
AU$120,000 - AU$140,000 (AUD)
Reference number
Valid Till
13 Jun, 2021 (32 days left)

How to Apply?

Please apply for this job on website:

More Job Vacancies

See all jobs