This script reads UniRef cluster XML files in batch using Spark-XML, extracts structured cluster-level fields (such as representative accession, sequence, member count, and common taxon ID), and writes the results to Delta Lake tables. It supports robust parsing for various nested and heterogeneous XML structures, producing both cluster-level and member-level tables for downstream analytics.
-
Notifications
You must be signed in to change notification settings - Fork 0
alinakbase/Spark-XML
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published