Vivanti Consulting is hiring a Databricks Specialist to join its growing global AI and data consultancy in the Greater Sydney Area, Australia.
The successful candidate will help design, build and optimise modern data platforms using Databricks, Delta Lake and Unity Catalog, while working on large-scale data, analytics and artificial intelligence projects for major businesses.
This is an opportunity for an experienced data professional to work across different industries, technologies and client projects while continuing to develop their technical and professional skills.
The company welcomes applications from candidates who are already in Australia as well as professionals considering relocating to Australia from overseas.
- Employer: Vivanti Consulting
- Job Title: Databricks Specialist
- Location: Greater Sydney Area, New South Wales, Australia
- Employment Type: Full-time
- Visa Sponsorship: Sponsorship opportunities available
Key Responsibilities
As a Databricks Specialist, you may be responsible for:
- Architecting, developing and optimising enterprise Lakehouse platforms.
- Working with Delta Lake and Unity Catalog.
- Building reliable batch and streaming data pipelines.
- Using PySpark, Spark Declarative Pipelines (SDP), Structured Streaming and Auto Loader.
- Migrating legacy data warehouses and Hadoop environments to modern Databricks platforms.
- Collaborating with data scientists, machine learning engineers and analytics teams.
- Operationalising machine learning models using MLflow and Databricks Model Serving.
- Improving workspace and query performance.
- Implementing cost-management and governance practices across large-scale cloud environments.
- Establishing security and governance using Unity Catalog.
- Implementing role-based access control, data lineage and row- and column-level security.
- Communicating technical decisions and trade-offs to clients and non-technical stakeholders.
Requirements
Vivanti Consulting is looking for candidates with strong hands-on experience in modern data engineering and Databricks environments.
Applicants should have:
- Demonstrable hands-on Databricks experience.
- Experience building and deploying data pipelines in production environments.
- Experience with Delta Lake, Unity Catalog and Databricks Workflows.
- Experience with orchestration or transformation tools such as Airflow, dbt, Kafka or Fivetran.
- Advanced Apache Spark and SQL skills.
- Strong Python/PySpark skills.
- Scala experience is an advantage.
- Working knowledge of at least one major cloud platform, including Azure, AWS or GCP.
- Understanding of Medallion Architecture, including Bronze, Silver and Gold layers.
- Strong understanding of data performance and cost optimisation.
- Ability to communicate complex technical concepts clearly to non-technical stakeholders.
Databricks Certification
A Databricks Data Engineer Professional certification is considered ideal.
However, candidates who are not currently certified may still be considered if they can demonstrate strong practical Databricks experience. The company states that it can support the successful candidate in obtaining the certification.
What Vivanti Consulting Offers
Employees can access a range of professional development and workplace benefits, including:
- Opportunities to work across different industries and technologies.
- Mentoring and professional support.
- Annual 360-degree progress reviews.
- Regular technical training.
- Learning opportunities with peers and technology partners.
- Paid certifications across major technologies.
- Hackathons and innovation days.
- Recognition and rewards programs.
- Team events and social activities.
- Opportunities to work with modern AI, data and cloud technologies.
About Vivanti Consulting
Vivanti Consulting describes itself as a global AI and data consultancy helping major businesses develop data, AI, cloud and digital solutions.
The company focuses on providing opportunities for talented technologists to work on meaningful projects while developing their technical and professional careers.
Who Can Apply?
The company indicates that it welcomes applications from:
- Candidates already living in Australia.
- Experienced technology professionals considering relocating to Australia.
- Overseas applicants who meet the technical requirements and are eligible for sponsorship.
The role is particularly suited to experienced Databricks specialists, data engineers and data platform professionals with strong production experience.
Visa Sponsorship for International Applicants
Vivanti Consulting explicitly states that it offers sponsorship opportunities.
This makes the position potentially suitable for qualified professionals currently outside Australia who are interested in relocating for work.
However, sponsorship is subject to the candidate meeting the company’s requirements and Australia’s applicable immigration and work-visa requirements. Applicants should confirm the specific visa pathway and sponsorship conditions with Vivanti Consulting during the recruitment process.
How to Apply
Interested candidates should submit their application through the employer’s recruitment listing and highlight their:
- Databricks experience
- Data engineering experience
- Spark and SQL skills
- Cloud platform experience
- Python/PySpark skills
- Relevant certifications
- Production data pipeline projects
- Experience working with enterprise data platforms
International applicants should clearly indicate that they are applying from overseas and require visa sponsorship.
Disclaimer: OpportunityShape shares international employment opportunities that may provide visa sponsorship or relocation pathways. We are not the employer or recruitment agency for this vacancy.
Visa sponsorship does not guarantee visa approval. Applicants should confirm the current availability of sponsorship, eligibility requirements, employment conditions and Australian visa requirements directly with Vivanti Consulting before making relocation or financial commitments.
