Variant and Variant shredding are now generally available
docs.databricks.com databricks.com
This is what was read here when it was published. databricks.com no longer carries it in what it publishes now.
Listen to this summary
Variant is now generally available. Variant is a flexible data type for semi-structured data that delivers structured-like query performance through Variant shredding, which is also generally available. Use Variant to ingest semi-structured data from streaming sources (Kinesis, Event Hub), REST APIs, and schemaless databases, while maintaining high-performance query access.
Starting with Databricks Runtime 17.3, Variant shredding is automatically enabled when you create a new table with VARIANT columns. For optimal query performance with variant statistics collection and data skipping, Databricks recommends Databricks Runtime 18.1 or above. See Use variant shredding to optimize performance.
More ways to use this
Open on another device
Scan to open this page. Your saved notes and account access are not included.