Chi tiết thông tin tuyển dụng "Data Platform Lead"
Mức lương
Thỏa thuận
Địa điểm
Hà Nội
Viettel Cyber Security (VCS) is a leading cyber security firm, dedicated to protecting digital infrastructures worldwide while conducting in depth research and analysis for security solutions. Leveraging 100% in house development, VCS offers a comprehensive range of cutting-edge cyber security solutions, protecting governments, financial institutions, large corporations and SMEs against sophisticated cyber threats in the digital age.
VCS is internationally recognized for its Champion titles at Pwn2Own 2023 & 2024, consistent Top 5 global rankings, the discovery of400+ zero-day vulnerabilities, and multiple prestigious honors, including Gold - Best Cyber Security Company in Asia.
2. Position Objective
Own the technical strategy, engineering delivery, and operational reliability of VCS's shared Internal Data Platform. Lead the development of a modern, self-service Lakehouse; maintain and reduce operational risks of the existing Hortonworks HDP 2.6.5 environment; and build reusable data capabilities for analytics, RAG, AI training and fine-tuning data preparation.
This is a hands-on technical leadership and platform ownership role, not primarily a data modeling or reporting position.
3. Key Responsibilities
Modern Lakehouse & Platform Engineering
Define the platform architecture, technology roadmap, reference designs, and engineering standards for a shared, production-grade Lakehouse serving multiple teams.
Lead technology evaluation, PoCs, implementation, integration, release, and continuous improvement across storage, ingestion, processing, SQL query, orchestration, metadata and access control.
Design batch and streaming data pipelines; establish data contracts, schema evolution, quality checks, observability, and repeatable deployment practices.
Provide self-service onboarding, tenant/workload isolation, documented APIs and data access patterns, usage monitoring, and cost/capacity visibility.
Assess and integrate legacy HDFS/Hive data access with the new platform where technically feasible; avoid assuming full legacy migration is required.
Legacy Big Data Operations
Lead maintenance and operational support for the existing Hortonworks HDP 2.6.5 environment, including HDFS, Hive, YARN and related services.
Own service reliability practices: monitoring, alerting, incident and problem management, troubleshooting, capacity planning, performance tuning, backup and recovery validation.
Identify security, supportability and technology obsolescence risks; prioritize mitigations and document operational runbooks and recovery procedures.
Coordinate infrastructure, security and consuming teams on changes, outages, data availability and continuity.
Data Enablement for Analytics & AI
Build reusable ingestion, transformation, cleaning, validation and dataset preparation capabilities for BI, analytics, cybersecurity use cases and AI teams.
Support governed datasets for RAG and model training/fine-tuning, including metadata, lineage, access controls, versioning and reproducible preparation pipelines.
Partner with AI/ML engineering teams on dataset interfaces and quality requirements; model development, training and inference remain with the respective AI/ML owners unless explicitly assigned.
Platform Ownership & Team Leadership
Own the internal platform backlog, technical priorities, milestones, delivery risks, service catalog and adoption roadmap.
Lead, coach and review the work of Data Platform engineers; establish design reviews, engineering quality standards and operational ownership.
Work with product teams, security, SRE/infrastructure and business stakeholders to translate requirements into reusable platform services.
Define and report service metrics such as availability, incident recovery, pipeline reliability, onboarding lead time, platform adoption and resource efficiency.
4. Requirements & Qualifications
Must-have
7+ years in Data Engineering, Big Data platforms or distributed systems, including demonstrable technical leadership of production systems.
Proven experience architecting, building and operating at least one production-grade Data Lake, Lakehouse or comparable shared data platform.
Strong hands-on Apache Spark experience for distributed batch processing and/or structured streaming, including tuning and troubleshooting.
Practical Apache Kafka experience for event streaming and data ingestion, including operational and delivery considerations.
Production experience with at least one modern open table format: Apache Iceberg or Delta Lake; sound understanding of ACID, schema evolution, partitioning and table maintenance.
Practical experience with Trino or a comparable distributed SQL engine; able to explain query architecture, workload isolation, performance and federated access trade-offs.
Hands-on Apache Airflow experience or equivalent production workflow orchestration; understands dependencies, retries, scheduling and monitoring.
Strong knowledge of Hadoop ecosystem (HDFS, Hive, YARN), including administration, incident diagnosis and performance optimization.
Sound knowledge of object storage, metadata/catalog architecture, Linux, SQL, Python or Java/Scala, distributed systems and data security.
Ability to lead engineers, make architectural trade-offs, manage delivery priorities and communicate with multiple consuming teams.
Nice-to-have
Direct experience with Hortonworks HDP 2.6.x, Cloudera or comparable legacy Hadoop distributions.
Hands-on S3-compatible object storage (MinIO/Ceph), Iceberg REST Catalog, Hive Metastore or Nessie.
Kubernetes, CI/CD, infrastructure as code, platform observability and multi-tenant platform operations.
Data governance, data catalog, lineage, data quality, RBAC/ABAC and audit controls.
Dataset engineering for RAG, model training/fine-tuning, security telemetry or large-scale log analytics.
Knowledge of dimensional modeling, Kimball/Inmon, DWH and BI use cases.
5. Success Measures
Deliver an agreed Lakehouse MVP and onboard production workloads from internal teams.
Maintain reliable legacy HDP services while reducing repeat incidents and operational/security risks.
Improve self-service onboarding, pipeline delivery reliability, dataset reuse and platform adoption.
Establish measurable platform SLIs/SLOs, operational runbooks, cost/capacity reporting and a prioritized roadmap.
6. Benefits & perks
· Competitive annual total income package
· Annual salary review in March.
· Bao Viet health and personal accident insurance (coverage up to 600 million VND/year)
· Annual health check-up
· Special support for female employees during maternity leave.
· Awards recognizing performance and timely outstanding contributions
· 100% sponsorship for in-depth international professional certification based on position (in case of unsuccessful attempt, don't worry, VCS will support 50% of the exam fee), special bonuses for employees achieving international professional certifications
· Continuous investment in the latest and most up-to-date learning materials in the field of Information Security from leading global vendors and institutes
· 100% of employees are provided with an Udemy eLearning account - learn anytime, anywhere
· Free participation in professional knowledge sharing programs and seminars from leading domestic and international speakers.
· Opportunity to work with diverse domestic and international clients
· Working in a Grade A office - Landmark 72 building with a green space complex and a private area for gym and entertainment (billiards, PES, café, reading, Pingpong)
· 30-minute relaxation daily with Happy hours (4:00 PM - 4:30 PM)
· Sports activities: Swimming, Pickleball, Billiards, Poker, PES, etc
· Twelve (12) days of annual leave according to Labor Law, three (3) days of company vacation and one (1) traditional holiday on 22/12.
· Personal birthday celebrations: Gifts and birthday cake from the Company
· Gift and participation in company events: Quarterly team building activities, monthly birthday celebrations, Year End Party, vacations, International Women's Day (March 8th), Vietnamese Women's Day (October 20th) (female employees receive 1⁄2 day off), Viettel Group birthday on June 1st, etc
· Care parents and children of employees on special occasions.
Location
● 41st Floor, Landmark 72 Tower, Pham Hung Street, Hanoi
Contact
Nguyễn Thị Quỳnh Thơ_HRBP_[protected info]
Cách thức ứng tuyển
Ứng viên nộp hồ sơ trực tuyến bằng cách bấm "Ứng tuyển" ngay dưới đây.
Thông tin công ty
Giới thiệu
Công ty An ninh mạng Viettel- Chi nhánh Tập đoàn Công nghiệp- Viễn thông quân đội
Môi trường làm việc và phúc lợi tại công ty an ninh mạng Viettel
- Được làm cùng nhân sự giỏi, nhân viên hòa đồng, sếp vui tính
- Văn phòng đẹp, các dự án đa dạng và trình độ chuyên môn tương đối cao, Môi trường làm việc chuyên nghiệp
- Trang thiết bị hiện đại, môi trường thoải mái, có happy time, thời gian làm việc linh động, không yêu cầu trang phục khắt khe
Văn phòng giao dịch:
- Miền Bắc: Tầng 41, Tòa Keangnam Landmark 72, Đ. Phạm Hùng, Q. Nam Từ Liêm, Hà Nội.
- Miền Nam: Tầng 23, Toà nhà Viettel, số 285 Đ. Cách Mạng Tháng 8, P. 12, Q.10, Hồ Chí Minh
Quy mô
Địa chỉ