docs2.alationdata.com
Open in
urlscan Pro
34.194.125.175
Public Scan
Submitted URL: https://email.alation.com/dc/1xL7LFq6vVv0a7FhEKF0JApuZ1pTCZ1so_c8KeQKekm63JWm_NSGxa2Vj3Ao6QOLZ7D5uzhv0XELqM6oPG3BynzBqoqRg...
Effective URL: https://docs2.alationdata.com/en/latest/releases/releasenotes/ReleaseNotes20233.html?mkt_tok=NjYwLVJVRS03MzgAAAGTHBzaJPdgZ6f9C...
Submission: On May 15 via api from US — Scanned from DE
Effective URL: https://docs2.alationdata.com/en/latest/releases/releasenotes/ReleaseNotes20233.html?mkt_tok=NjYwLVJVRS03MzgAAAGTHBzaJPdgZ6f9C...
Submission: On May 15 via api from US — Scanned from DE
Form analysis 1 forms found in the DOM
GET ../../search.html
<form id="rtd-search-form" class="wy-form" action="../../search.html" method="get">
<input type="text" name="q" placeholder="Search this project" aria-label="Search this project" id="searchinput">
<input type="hidden" name="check_keywords" value="yes">
<input type="hidden" name="area" value="default">
</form>Text Content
* Alation Help Center
*
Welcome to Alation
* About Alation
* Alation Support Portal
* Alation Portal: Support Regions
* Alation Cloud and On-Premise
* User Profile and Preferences
* Manage Account Settings
* Edit Your Preferences and Profile
* Catalog Basics
* Alation Versions
* Roles Overview
* Access, Roles, and Permissions
* Viewer Role
* Homepage
* Navigation
* Search
* Marketplaces
* Soft Delete & Hard Delete
* Catalog Pages
* Classic User Experience
* New User Experience
* Document Hubs
* Conversations
* Finding Conversations
* Using Your Inbox
* Posting a New Conversation
* Interacting with Conversations
* Domains
* Domains Overview
* Manage Domains
* Search with Domains
* Best Practices
* Write Articles to Retain Institutional Knowledge
* Curate Catalog Pages to Clarify Your Data
* Use Trust Flags and Proceed with Confidence
* Alation/Tableau Best Practices
* Alation Glossary
Alation Cloud Service
* Status Page
* Cloud Service Overview
* Geographic Availability
* Cloud Networking
* Non-Production Environments in the Cloud
* Cloud Service Security
* Alation Cloud Roles and Responsibilities
* Migrating from On-Prem to Cloud
* Configuration for Cloud
* Alation’s IP Addresses for Allow Lists
* Whitelist the Alation Cloud Service IP
* AWS PrivateLink with Alation Cloud Service
* Reconfigure Azure AD and Okta for Alation’s Cloud Native Architecture
* Cloud Service Configuration Limitations
* Alation Agent
* Agent Release Notes
* Install the Alation Agent
* Connect the Agent to Data Sources
* Manage Connectors
* Work with the Agent’s Certificates
* Upgrade the Agent
* Update the Agent’s Address Configuration
* Delete and Reconnect the Agent in Alation
* Uninstall and Reinstall the Agent Software
* Start and Stop the Agent
* Troubleshoot the Agent
* Alation Agent Version History
Alation Integrations
* Alation Anywhere
* Alation Anywhere for Slack
* Alation Anywhere for Tableau
* Alation Anywhere for Microsoft Teams
* Alation Connected Sheets
* Get Started with Connected Sheets
* Use Connected Sheets
* Set Up Snowflake OAuth with Connected Sheets
Installation & Configuration
* Install Alation
* Preparing for Installation
* System Requirements
* Network Requirements
* Installation Readiness
* Installation Process
* User Authentication Setup
* User Authentication with LDAP
* Configure Authentication with SAML from Alation Shell
* Configure Authentication with SAML from Admin Settings
* Configure Authentication with OpenID Connect
* Enable SCIM Integration for User and Group Management
* Manage Token Authentication for SCIM Sync
* Test SCIM Configuration
* View SCIM Configuration in alation_conf
* Troubleshoot SCIM Configuration
* Set Up SCIM Integration in Okta
* Set Up SAML and SCIM Integration in PingFederate
* Set Up SAML and SCIM Integration in Azure AD
* Email Server Configuration
* HTTPS
* Installing on High Availability (HA) Pair
* Sizing Guidelines Detail
* How to Configure Alation to Use HTTP Proxy for All Web-bound Traffic
* How to Change the Base URL
* How to Update a License File
* High Availability
* Overview of High Availability
* HA Requirements
* Set Up High Availability
* Revert the High Availability Pair to Standalone Mode
* Failover to Secondary
* Migrate from Legacy to Supported High Availability
* Set up Replication on HA Pair (4.7 and Below)
* Update Alation
* Update Alation to 2024.1
* Update Alation to 2023.3
* Update Alation to 2023.1
* Update Alation to 2022.4
* Re-Encrypt Existing Data
* Update Alation to 2022.3
* De-duplicate Mixed Case Usernames
* Update Source Field for Dataflow Objects
* Update Alation to 2022.2
* Update Alation to 2022.1
* Resetting ETL Checkpoint for User Data
* Update Alation to 2021.4
* Update Alation from 2021.4.x to 2021.4.4 or Later Patches
* Validating the Value of Parameter elasticsearch.env.es_java_opts
* Update Alation to 2021.3
* Update Alation to 2021.2
* Update Alation to 2021.1
* Update Alation to 2020.4
* Pre-Update Reindexing Script for 2020.4
* Update Alation to 2020.3
* Updating Alation to V R7 (5.12.x)
* Elasticsearch Upgrade to 7.4 FAQ and Troubleshooting
* Update Alation to V R6 (5.10.x)
* Upgrade Internal PostgreSQL Instances from 9.3 to 9.6
* Update Alation to V R5 (5.9.x)
* Update Safety Best Practices
* Release-specific Update Pre-checks
* Manual Software Update for Standalone Systems
* Update HA Pair Configuration (4.7 and above)
* Update HA Pair with Cluster Splitting
* Update Alation Connector Manager
* Back Up and Restore
* Backup V1 and Backup V2
* Check Current Backup Tool
* Enable or Disable Backup V2
* Backup V1 in Versions 2021.4 or Newer
* Backup V2 Process
* Backup V1 Process
* Configure Backups
* Configure Incremental Backups
* Set Up a Custom Backup Schedule
* Copy Backup Files to a Remote Location
* Define the Number of Backups to Retain
* Old Backup Cleanup
* Backup Configuration Parameters
* Create Backups Manually
* Find Backups
* Monitor Backups
* Manage Postgres Backups Separately
* Restore from a Backup
* Restore Alation
* Restore Alation With a Separate Postgres Backup
* Restore OCF Components
* Restore Alation Analytics V2
* Restoring Alation Analytics V1
* Enable Lineage Frameworks
* Enable Lineage V2
* Enable Lineage V3
* Alation Analytics V2
* Transition from Alation Analytics V1 to Alation Analytics V2
* Enable and Install Alation Analytics V2
* User Access to Alation Analytics V2
* Connect Third-Party BI Tools to Alation Analytics V2
* Alation Analytics V2 Server Architecture
* Update Alation Analytics V2
* Alation Analytics V2 ETL
* Maintain Alation Analytics V2
* Clear the Data from the Alation Analytics V2 Database
* Alation Analytics V2 Backup and Restore
* Remove Alation Analytics V2 Data Source From the Catalog
* Uninstall Alation Analytics V2
* Remove Alation Analytics V1 Data Source From the Catalog
* Alation Analytics V2 Database Model
* Embed External Visualizations
* Alation Analytics V2 Dashboard
* Alation Analytics Top Contributors Report
* Alation Container Service
* Install Docker Using Alation Container Service
Sources
* Catalog Sources
* Types of Catalog Sources
* Sources Page
* Access Tab
* Metadata Extraction
* Query Log Ingestion
* Deleting a Data Source
* Virtual Data Sources
* Virtual Data Source for NoSQL Databases
* Adding a NoSQL Virtual Data Source
* Avro Data Types Support
* Viewing the Avro Schema Catalog Page
* Viewing NoSQL Schemas in Virtual Data Sources
* Schema Versioning for NoSQL Virtual Data Sources
* Loading Metadata into a NoSQL Virtual Data Source
* Populating a Virtual Data Source From a CSV File
* Explore Lineage
* Analyze Lineage Charts
* Leverage Lineage Impact Analysis
* Dataflow Objects
* Create Lineage Data Manually
* Enable Manual Lineage Curation
* Configure Lineage Charts
* API Resources
* Working with Catalog Data
* Extract Synonyms
* Download a Data Dictionary
* Importing a Data Dictionary in Alation 2023.3.2 and Later
* Importing a Data Dictionary in Alation 2023.3.1 and Earlier
* Uploading Data
* View Field History
* Struct Data Type in Hive Data Sources
* Deprecation Propagation Feature
* Add Endorsements, Warnings, and Deprecation Messages to Data
* How Top User Expertise Is Calculated
* Upvoting and Downvoting Top Users
* Data Popularity
* View Data Health
* Table Lineage
* Columns and Samples
* Open Connector Framework
* Open Connector Framework (OCF) Release Notes
* Open Connector Framework (OCF) Overview
* Install Alation Connector Manager
* Auto-Install Docker as Alation Connector Manager Dependency
* Install Docker for Alation Versions 2020.3.x - 2021.1.x
* Install OCF BI Connectors
* Manage Connectors
* Maintaining OCF Connectors
* OCF Connector Catalog User Experience
* Troubleshooting
* Migrate Native Sources to Open Connector Framework
* Migrate Native RDBMS Data Sources to OCF Connectors
* Migrate Custom DB Data Sources to OCF Connectors
* Migrate Native File System Sources to OCF Connectors
* Migrate Native BI Sources to OCF Connectors
* Configure Secrets for OCF Connector Settings
* Integration with AWS Secrets Manager for Data Source Authentication Using
OCF Connector
* Configure a Role to Assume on Behalf of Alation’s Instance Profile
* Configure a Role to Assume on Behalf of a User
* Establish a User to Access Secrets Manager
* Configure Authentication with AWS Secrets Manager in Data Source
Settings
* Integration with Azure Key Vault for Data Source Authentication Using OCF
Connector
* Configure Authentication via AWS STS and an IAM Role
* Configure Access to OCF Data Sources
* Configure Access to OCF BI Sources
* Configure Metadata Extraction for OCF Data Sources
* Configure Sampling and Profiling for OCF Data Sources
* Configure Compose for OCF Data Sources
* Schema Path Pattern
* BI Connection Info
* Recreate Databricks Logging Script Under Workspace
* Amazon Athena OCF Connector
* OCF Connector for Amazon Athena: Overview
* OCF Connector for Amazon Athena: Install and Configure
* OCF Connector for Amazon Athena: Query Log Ingestion
* OCF Connector for Amazon Athena: SSO with Compose
* AWS Glue OCF Connector
* AWS Glue OCF Connector: Overview
* AWS Glue OCF Connector: Install and Configure
* Amazon S3 OCF Connector
* Amazon S3 Connector Release Notes
* Overview
* Prerequisites
* Set Up OCF Connector for Amazon S3
* Configure Connection to File System Source
* Configure Metadata Extraction
* Version 3.9.0 or Newer
* Versions Prior to 3.9.0
* Set Up Incremental MDE
* Use File Sampling
* Configure Server-Side Encryption
* Scale Amazon S3 OCF Connector
* Use Terraform to Set Up Inventory and Incremental MDE
* Migrate a Native S3 Source to OCF
* Troubleshoot the OCF S3 Connector Configuration
* Azure Blob Storage OCF Connector
* Azure Blob Storage OCF Connector: Overview
* Azure Blob Storage OCF Connector: Install and Configure
* Azure Blob Storage OCF Connector: Azure Service Principal Authentication
* Azure Databricks OCF Connector
* Azure Databricks OCF Connector Release Notes
* Azure Databricks OCF Connector: Overview
* Azure Databricks OCF Connector: Install and Configure
* Azure Databricks OCF Connector: Query Log Ingestion
* Azure Databricks OAuth for User Connections
* Azure SQL DB OCF Connector
* Azure SQL DB OCF Connector: Overview
* Azure SQL DB OCF Connector: Install and Configure
* Extraction Queries for Azure SQL DB
* Azure Synapse Analytics OCF Connector
* Azure Synapse Analytics OCF Connector Release Notes
* Azure Synapse Analytics OCF Connector: Overview
* Azure Synapse OCF Connector: Install and Configure
* Extraction Queries for Azure Synapse Analytics
* Azure Cosmos DB OCF Connector (Public Preview)
* Overview
* Prerequisites
* Set Up Azure Cosmos DB OCF Connector
* Configure the Data Source Connection
* Configure Metadata Extraction
* Configure Compose
* Configure Sampling and Profiling
* Troubleshooting
* Databricks on AWS OCF Connector
* Databricks on AWS OCF Connector Release Notes
* Databricks on AWS OCF Connector: Overview
* Databricks on AWS OCF Connector: Install and Configure
* Databricks on Google Cloud OCF Connector
* Databricks on Google Cloud OCF Connector Release Notes
* Overview
* Prerequisites
* Set Up Databricks on Google Cloud OCF Connector
* Configure Connection to Data Source
* Configure Metadata Extraction
* Configure Sampling and Profiling
* Troubleshooting
* Databricks Unity Catalog OCF Connector
* Databricks Unity Catalog OCF Connector Release Notes
* Connector Overview
* Setup Prerequisites
* Set Up the Databricks Unity Catalog Connector
* Manage Access to the Data Source
* Configure the Data Source Connection
* Configure Metadata Extraction
* Lineage Extraction (Beta)
* Configure Sampling and Profiling
* Query Log Ingestion (Beta)
* Configure Compose
* Troubleshooting
* Azure Databricks OAuth for User Connections
* Add-On OCF Connector for dbt
* Add-On OCF Connector for dbt Release Notes
* Add-On OCF Connector for dbt: Overview
* Add-On OCF Connector for dbt: Install and Configure
* Reparse the Data Source Views
* Denodo OCF Connector
* Denodo OCF Connector Release Notes
* Denodo OCF Connector: Overview
* Denodo OCF Connector: Install and configure
* Amazon DynamoDB OCF Connector (Public Preview)
* Amazon DynamoDB OCF Connector (Public Preview): Overview
* Amazon DynamoDB OCF Connector (Public Preview): Install and Configure
* Elasticsearch OCF Connector (Public Preview)
* Elasticsearch OCF Connector (Public Preview): Overview
* Prerequisites
* Set Up Elasticsearch OCF Connector
* Configure Connection to Data Source
* Appendix - Authentication Schemes
* Amazon EMR Presto OCF Connector
* Amazon EMR Presto Connector: Overview
* Amazon EMR OCF Connector: Install and Configure
* Add-on OCF Connector for Fivetran
* Add-On OCF Connector for Fivetran: Overview
* Add-On OCF Connector for Fivetran: Install and Configure
* Case Study: Combining Lineage from Fivetran and dbt
* Google BigQuery OCF Connector
* OCF Connector for Google BigQuery Release Notes
* Overview
* Prerequisites
* Set Up OCF Connector for Google BigQuery
* Configure Connection to Data Source
* Configure Metadata Extraction
* Version 1.3.0 or Newer
* Versions Before 1.3.0
* Configure Compose
* Configure Sampling and Profiling
* Configure Query Log Ingestion
* Version 1.3.0 or Newer
* Versions Before 1.3.0
* Greenplum OCF Connector
* Greenplum OCF Connector Release Notes
* Greenplum OCF Connector: Overview
* Greenplum OCF Connector: Install and Configure
* Extraction Queries for Greenplum
* Hive OCF Connector
* Hive OCF Connector Release Notes
* Hive OCF Connector: Overview
* Hive OCF Connector: Install and Configure
* HDFS OCF Connector
* HDFS OCF Connector: Overview
* HDFS OCF Connector: Install and Configure
* IBM Db2 Database OCF Connector
* IBM Db2 Database OCF Connector Release Notes
* Db2 OCF Connector: Overview
* Db2 OCF Connector: Install and Configure
* Extraction Queries for IBM Db2 Database
* Impala on CDH OCF Connector
* OCF Connector for Impala on CDH Release Notes
* Impala on CDH OCF Connector: Overview
* Impala on CDH OCF Connector: Install and Configure
* Impala on CDP OCF Connector
* OCF Connector for Impala on CDP Release Notes
* OCF Connector for Impala on CDP: Overview
* OCF Connector for Impala on CDP: Install and Configure
* OCF Connector for Impala on CDP: Supported Combinations of Authentication
Types
* Informatica PowerCenter OCF Connector
* Informatica PowerCenter Connector: Overview
* Informatica PowerCenter Connector: Install and Configure
* Kafka OCF Connector (Public Preview)
* Kafka OCF Connector: Overview (Public Preview)
* Prerequisites
* Set Up Kafka OCF Connector
* Configure Connection to Data Source
* Appendix - Authentication Schemes
* MicroStrategy OCF Connector
* MicroStrategy OCF Connector Release Notes
* MicroStrategy OCF Connector: Overview
* MicroStrategy OCF Connector: Install and Configure
* MicroStrategy OCF Connector: Migrate from Native MicroStrategy to OCF
* MongoDB OCF Connector
* MongoDB OCF Connector Release Notes
* MongoDB OCF Connector: Overview
* MongoDB OCF Connector: Install and Configure
* MySQL OCF Connector
* MySQL Connector: Overview
* MySQL Connector: Install and Configure
* Looker OCF Connector
* Looker Connector: Overview
* Looker Connector: Install and Configure
* Upgrade Looker OCF Connector to Version 1.4.1
* Oracle OCF Connector
* Oracle OCF Connector Release Notes
* Overview
* Prerequisites
* Set Up OCF Connector for Oracle
* Configure Connection to Data Source
* Configure Metadata Extraction
* Version 1.5.0 or Newer
* Versions Before 1.5.0
* Configure Sampling and Profiling
* Configure Query Log Ingestion
* Version 1.5.0 or Newer
* Versions Before 1.5.0
* Troubleshooting
* Oracle OCF Connector Extraction Queries
* Configure QLI for Oracle on AWS RDS
* PostgreSQL OCF Connector
* PostgreSQL OCF Connector Release Notes
* Overview
* Prerequisites
* Set Up OCF Connector for PostgreSQL
* Configure Connection to Data Source
* Configure Metadata Extraction
* Version 1.2.0 or Newer
* Versions Before 1.2.0
* Extraction Queries for PostgreSQL
* Configure Compose
* Configure Sampling and Profiling
* Configure Query Log Ingestion
* Version 1.2.0 or Newer
* Versions Before 1.2.0
* PostgreSQL On Amazon EC2 and Enterprise Query Log Ingestion
* PostgreSQL Connector RDS: Query Log Ingestion
* Native to OCF Migration
* Troubleshooting
* Azure Power BI OCF Connector (Legacy)
* Azure Power BI OCF Connector (Legacy): Overview
* Azure Power BI OCF Connector (Legacy): Install and Configure
* Azure Power BI Scanner OCF Connector
* Azure Power BI Scanner OCF Connector Release Notes
* Azure Power BI Scanner OCF Connector: Overview
* Azure Power BI Scanner OCF Connector: Install and Configure
* Azure Power BI Scanner OCF Connector: Dataflows
* QlikSense OCF Connector
* Qlik Sense Enterprise Connector: Overview
* Qlik Sense Enterprise Connector: Install and Configure
* Amazon Redshift OCF Connector
* Amazon Redshift OCF Connector Release Notes
* Amazon Redshift OCF Connector: Overview
* Prerequisites
* Set Up OCF Connector for Amazon Redshift
* Configure Connection to Data Source
* Configure Metadata Extraction
* Version 1.7.0 or Newer
* Versions Before 1.7.0
* Configure Compose
* Configure Sampling and Profiling
* Configure Query Log Ingestion
* Version 1.7.0 or Newer
* Versions Before 1.7.0
* Extraction Queries for Amazon Redshift
* Troubleshooting
* Salesforce OCF Connector
* Salesforce OCF Connector Release Notes
* Overview
* Prerequisites
* Set Up Salesforce OCF Connector
* Configure the Data Source Connection
* Configure Metadata Extraction
* Configure Compose
* Configure Sampling and Profiling
* Migrate Salesforce Data Sources to OCF Connectors
* Troubleshooting
* SAP ASE (Sybase ASE) OCF Connector
* SAP ASE OCF Connector: Overview
* SAP ASE OCF Connector: Install and configure
* Extraction Queries for SAP ASE
* SAP BusinessObjects OCF Connector
* SAP BusinessObjects Connector Release Notes
* SAP BusinessObjects Connector: Overview
* SAP BusinessObjects Connector: Install and Configure
* SAP BW OCF Connector
* SAP BW OCF Connector Release Notes
* SAP BW Connector: Overview
* SAP BW Connector: Install and Configure
* SAP ECC OCF Connector
* SAP ECC OCF Connector Release Notes
* SAP ECC OCF Connector: Overview
* SAP ECC OCF Connector: Install and Configure
* SAP HANA OCF Connector
* SAP HANA OCF Connector: Overview
* SAP HANA OCF Connector: Install and Configure
* Extraction Queries for SAP HANA
* SAP IQ OCF Connector
* SAP IQ OCF Connector: Overview
* SAP IQ OCF Connector: Install and Configure
* Extraction Queries for SAP IQ
* SAS Base OCF Connector
* Connector Overview
* Setup Prerequisites
* Set Up the SAS Base OCF Connector
* Configure the SAS Base OCF Connector
* Extraction Queries for SAS Base
* ServiceNow OCF Connector (Public Preview)
* ServiceNow OCF Connector: Overview
* Prerequisites
* Set Up ServiceNow OCF Connector
* Configure Connection to Data Source
* SingleStore OCF Connector
* SingleStore OCF Connector Release Notes
* SingleStore OCF Connector: Overview
* SingleStore OCF Connector: Install and Configure
* Extraction Queries for SingleStore
* Snowflake OCF Connector
* Snowflake Connector Release Notes
* Overview
* Prerequisites
* Set Up Snowflake OCF Connector
* Configure Connection to Data Source
* Configure Metadata Extraction
* Version 2.2.9 or Newer
* For Old User Interface
* Configure Query Log Ingestion
* Version 2.2.9 or Newer
* For Old User Interface
* Configure Compose
* Configure Sampling and Profiling
* Enable Lineage
* Troubleshooting
* Snowflake OCF Connector Extraction Queries
* Snowflake OAuth For User Connections
* Configure OAuth Via Snowflake Built-In OAuth Service
* Configure Authentication Via Snowflake External OAuth
* Configuration in Okta
* Configuration in PingFederate
* Configuration in Azure Active Directory
* Role Switching with Snowflake OAuth
* Connect with OAuth from Compose
* Authorization Error Messages
* SQL Server OCF Connector
* SQL Server OCF Connector Release Notes
* SQL Server Connector: Overview
* Prerequisites
* Set Up OCF Connector for SQL Server
* Configure Connection to Data Source
* Configure Metadata Extraction
* Version 1.5.0 or Newer
* Versions Before 1.5.0
* Extraction Queries for SQL Server
* Configure Sampling and Profiling
* Configure Query Log Ingestion
* SQL Server Connector
* SQL Server RDS
* Azure SQL Managed Instance
* Configure QLI for Version 1.5.0 or Newer
* Configure Compose
* Troubleshooting
* SQL Server Analysis Services OCF Connector (Public Preview)
* Overview
* Prerequisites
* Set Up SQL Server Analysis Services OCF Connector
* Configure the Data Source Connection
* Configure Metadata Extraction
* Configure Sampling and Profiling
* Troubleshooting
* SSRS OCF Connector
* SSRS OCF Connector Release Notes
* SSRS OCF Connector: Overview
* SSRS OCF Connector: Install and Configure
* Starburst Trino OCF Connector
* Starburst Enterprise (Trino) OCF Connector Release Notes
* Starburst Trino OCF Connector: Overview
* Starburst Trino OCF Connector: Install and Configure
* Tableau OCF Connector
* Tableau OCF Connector Release Notes
* Tableau OCF Connector: Overview
* Prerequisites
* Set Up OCF Connector for Tableau
* Configure Connection to BI Source
* Configure Metadata Extraction
* Version 1.9.0 or Newer
* Versions Before 1.9.0
* Metadata Upload
* Popularity
* Configure Lineage for OCF Tableau BI Source
* Limitations and Troubleshooting
* Migrate from Tableau Native Connector to OCF
* Talend OCF Connector (Public Preview)
* Overview
* Prerequisites
* Set Up Talend OCF Connector
* Configure the Data Source Connection
* Configure Metadata Extraction
* Troubleshooting
* Teradata OCF Connector
* Teradata OCF Connector Release Notes
* Teradata OCF Connector: Overview
* Teradata OCF Connector: Install and Configure
* Extraction Queries for Teradata
* TIBCO Data Virtualization OCF Connector (Public Preview)
* TIBCO Data Virtualization OCF Connector Release Notes
* Overview
* Prerequisites
* Set Up TIBCO Data Virtualization OCF Connector
* Configure the Data Source Connection
* Configure Metadata Extraction
* Configure Sampling and Profiling
* Troubleshooting
* TIBCO Spotfire OCF Connector
* Overview
* Prerequisites
* Set Up TIBCO Spotfire OCF Connector
* Configure TIBCO Spotfire OCF BI Source
* Vertica OCF Connector
* Vertica OCF Connector: Overview
* Vertica OCF Connector: Install and Configure
* Extraction Queries for Vertica
* Delete an OCF Connector Source
* Delete a Data Source
* Delete a File System Source
* Delete a BI Server Source
Data Sources
* Data Source Configuration
* Prerequisites
* Add Data Sources
* Configuring a Data Source
* Table Privacy Settings
* Installing Certificates for Secure Data Source Connections
* Configuring Kerberos for Data Source Authentication
* Feature Flags For Data Sources
* Adding Data Sources
* AWS Glue without Hive
* Azure Synapse Analytics
* Cassandra
* Databricks on AWS
* DB2 LUW
* Greenplum
* Impala
* MongoDB
* MemSQL
* MySQL
* Netezza
* Oracle
* PostgreSQL
* Presto on Hive
* Amazon Redshift
* Salesforce
* SAP Hana
* SAS
* Snowflake
* SQL Server
* Sybase IQ
* Sybase Adaptive Server Enterprise (ASE)
* Teradata
* Vertica
* Kerberos Configuration (General)
* Configure Alation DB
* Appendix
* Compose SSO for Amazon Data Sources
* Compose SSO for Amazon Data Sources: Create Authentication Application
* Compose SSO with Amazon Sources: Configure AWS IAM Plug-in
* SSO Authentication for Amazon Athena Data Source
* SSO Authentication for Amazon DynamoDB Data Source
* SSO Authentication for Amazon Redshift Data Source
* Troubleshoot SSO Authentication with Amazon Data Sources
* Compose SSO for Azure Data Sources
* Compose SSO for Azure Data Sources: Register an Application in Azure AD
* Compose SSO for Azure Data Sources: Configure Compose SSO in Alation
* OAuth Plugin CRUD Operations
* Authentication for Extraction
* Configure Extraction with AWS IAM Authentication
* Troubleshoot the Configuration of MDE with IAM Authentication
* Integration with Azure Key Vault for Data Source Authentication
* Custom DB
* Add Custom Drivers
* CData Drivers
* Driver Fixer
* Add Custom DB to Alation
* Metadata Extraction From Custom DB
* Guidelines for Creating Queries for MDE
* Sampling and Profiling
* QLI From Custom DB
* File-Based Query Log Ingestion
* View-Based QLI
* SQL Query QLI
* Amazon Athena
* Update Simba JDBC Driver for Amazon Athena to Support SSO
* Amazon DynamoDB
* Azure Cosmos DB
* Azure Data Warehouse (Azure SQL DW)
* Confluent Kafka
* Databricks for Custom DB
* Databricks Azure
* Azure Databricks: Configure SSO through OAuth for Compose
* Denodo
* Elasticsearch
* EMR SparkSQL
* EMR Presto on Hive with AWS Glue as Metastore
* GCP Databricks
* GitHub
* MariaDB
* MarkLogic
* MongoDB
* MongoDB Atlas
* NetSuite
* Parquet (Amazon S3)
* Salesforce
* ServiceNow
* Splunk
* SQL Server Analysis Service (SSAS)
* Starburst Enterprise (Presto)
* Starburst Enterprise (Trino)
* Example Queries for Query-Based MDE
* Example JSONs for File-Based QLI
* Troubleshooting for CData Data Sources
* Google BigQuery
* Google BigQuery Prerequisites
* Google BigQuery Setup in Alation
* Google BigQuery FAQ
* Troubleshooting
* Additional Information
* Hive
* Hive Overview
* Add Hive Data Sources to Alation
* Configuration-Based Hive
* Default Hive
* Hive Data Source Settings
* Migrating Existing Hive Data Sources to Configuration-Based Hive
* Hive with AWS Glue Metastore
* Hive 2 on EMR with QLI over Amazon S3
* Hive Tez Query Log Ingestion Setup
* Spark Support for Hive
BI Sources
* Add BI Sources
* How To Set BI Tool Feature Flags
* Add a BI Server as a Source
* Extract BI Server Metadata
* MicroStrategy
* SQL Server Reporting Service (SSRS)
* Custom BI Tools
* Disable Automatic Lineage Generation FAQ
* Add Tableau Server
* Prerequisites for Adding a Tableau Source to Alation
* Add Tableau Sources on GBM V2
* Tableau Troubleshooting Tips
* Working with BI Sources
* Overview of Catalog Pages for Tableau Sources on the Generic BI Model
* Tableau Permission Mirroring
* Set Permissions for Tableau Objects Flags
* GBM V2 APIs Overview
* Types of BI Tools
* Report Catalog Page
* Finding Source Data Lineage
* Importing Report Metadata
File System Sources
* Add File Systems
* Add a File System
* Access to File Systems
* Azure Blob Storage
* Azure Data Lake Storage (ADLS)
* HDFS
* Amazon S3
* Virtual File Systems
* Set up and Populate Virtual File Systems
Alation for Analysts
* User Authentication for Data Sources
* Working with Data Source Connections
* Switching and Removing Data Source Accounts
* Transient User Credentials
* Authenticate to AWS Data Sources with SSO
* Share and Access Queries
* Share and Access Queries - 2023.1 and Later
* Understand Query Access
* Change Access to a Query
* Share a Query
* Change Visibility of Unpublished Queries
* Share and Access Queries - 2022.4 and Earlier
* Granting Access to Queries in Compose
* Sharing Queries in Compose
* Granting Access and Sharing Queries in the Catalog
* Adding Query Authors in the Catalog
* Requesting Access to Queries
* Viewing Queries by Other Users
* Write Queries
* Data Browser
* Compose Toolbars
* Writing Queries Faster and Embedding Code Snippets
* Start a New Query
* Find and Open Queries
* Publish a Query
* Differences between Publishing and Saving a Query
* Understanding Query Warnings
* Upload Old Queries
* Take Turns Editing a Query
* Delete (Discard) a Query
* Custom DB Column Profile Preview
* Keyboard Shortcuts
* Quick Compose Navigation Tips
* Develop Queries
* Schedule Queries
* Query Version History
* Comparing Versions in Query Version History
* Saving Queries and Types of Query Versions
* Undoing a Restore from Query Version History
* Cloning Queries
* Previewing Your Data as You Work
* Query Forms
* Use Query Forms
* Create a Query Form
* Apply Code Completion While Writing
* Reusing Filters and Joins
* Run Options
* Viewing Query Revision History
* Query Groups
* Work with Query Results
* Save Query Results
* Results of Scheduled Queries
* View Query Results History
* Building a Pivot Table
* Copy the Query SQL Code From the Results Pane
* Embedding Results in an Article
* Share Query Results
* Export and Download Query Results
* Download Query Results
* Export Query Results To a File
* Export Query Results to Plot.ly
* Export Query Results to Tableau
* Excel Live Reports
* Configure Query Results
* Configure Query Result Row Limit
* Configuring Query Result Size
* Manage Preservation of Query Results
* Manage Sharing of Query Results
Alation for Data Stewards
* Governance App
* Data Governance Page
* Policy Center
* Using Policy Center
* Working with Data Policies
* Working with Policies
* Curating Policies
* Policy Groups
* Policy Center Permissions
* Workflow Center
* Configuring Workflow Center
* Managing Workflows
* Suggesting Changes
* Governance Dashboard
* Using the Governance Dashboard
* Configuring the Governance Dashboard
* Stewardship Workbench
* Configuring Stewardship Workbench
* Using Stewardship Workbench
* Bulk Update Custom Fields
* Bulk Update Stewards
* Bulk Update People Sets
* Analytics Stewardship
* Stewardship Dashboard
* Curation Progress
* Working with the Catalog Activity Report
* Data Objects Without Stewards
* Using the Titles and Descriptions Chart
* Document Hubs
* Glossary
* Work with Glossaries
* Glossary Permissions
* Migrate Articles to Glossary Terms
* Bulk Create or Edit Glossary Terms
* Articles and Tags
* Work with Articles
* Autosave for Articles
* Enrolling Articles into Agile Approval
* Bulk Create or Edit Articles
* Inserting an Excel Table into an Article
* How to Use Tags
* Article Groups
* Create an Article Group
* Work with Article Groups
* Run Lexicon to Suggest Words
* Work with Suggested Words
* Frequently Asked Questions about Suggested Words
* Customize Your Data Catalog
* Understanding Catalog Templates
* Creating Custom Fields for Catalog Pages
* Applying Custom Fields to Templates
* Custom Field Permissions
* Creating Object Set Back References
* Edit Object Templates
* Editing Object Template Layout
* Build Term Type Templates
* Build Custom Templates for Articles
* Using Custom Article Templates
* Create Articles and Article Template Custom Fields
* Data Documentation
* Create and View Catalog Sets
* Conditional Catalog Sets
* Bulk-Editing Conditional Catalog Set Members
* Manual Catalog Sets
* Value Title Lookup
* Creating and Using Catalog Sets
* Frequently Asked Questions about Catalog Sets
* Auto-titling and Lexicon
* Robot Heads
* Run Lexicon - First Time
* Auto-Titling
* Work with the Lexicon - 2020.4 and Later
* Run the Lexicon Job Manually
* Frequently Asked Questions about Lexicon
* Configure Lexicon Manually and Upload Lexicon
* Title Your Data
* Snowflake Tags
Alation for Server Administrators
* Customizable Homepage
* Group-Based Homepages - 2023.3.4 and Later
* Role-Based Homepages - 2022.3 to 2023.3.3
* Customize Homepage - 2020.3 to 2022.2
* Administrator Settings
* Manage Users
* User Profiles Tab: Bulk User Account Creation
* Authentication Tab
* Authentication Configuration Methods for External Systems
* Manage Access to Alation Using LDAP Filters
* Manage Groups
* SCIM Groups
* Group Profile Page
* Configure LDAP Groups
* Use Custom Groups to Assign User Roles
* Email Server Tab
* Bulk Utility
* License
* Manage Encryption Keys
* Feature Configuration
* Enable Document Hubs, Glossaries, and Terms
* Compose Settings Tab
* Software Updates Tab
* Reporting Usage
* Logging Tab: Sending Encrypted Logs
* Misc Tab
* Add Your Company’s Branding
* Add Alert Banners to the Homepage
* Manage Scheduled Queries
* Monitor Component Health
* Monitor Tasks
* Additional Configuration
* Using alation_conf
* Obfuscate Literals in View SQL
* Enable Alation Analytics Top Contributors Report
* Editing /etc/hosts
* Enable Table Privacy
* Deferred Query Execution
* Managing Space: Monitor Postgres Table Size
* Managing Space: Purge Query Results
* Manage Access to Data Export and Download
* Disable the Username Migration
* Disable or Enable User Credentials Storage
* Configure the API Tokens Management Feature
* Configure Service Cloud Access for Designated Admins
* Configure Access to the Internal Help Desk
* Enable Permission for Data Source Admin to Add Sources
* Enable Pagination for Lineage
* Enable Debug Mode for Capturing the Detailed Level Logs (Custom DB)
* Enable or Disable Marketplaces
* Enable Connected Sheets Hub
* Enable Removability of Object-defined Fields
* Enable or Disable Search Autocomplete
* Enable Custom Field Search
* Disable the Not Set Filter Option
* Enable the Lexicon Search
* Set Search Ranking by Object Type
* Set Search Ranking for the Endorsement and Deprecation Flags
* Set Password for Internal PostgreSQL Instances
* Use ALLIE AI to Suggest Stewards
* Set stewardship.curation_progress.ingestion.batch_size Parameter
* Set bulk_insert_sql_str_length_limit Parameter
* Beta Azure Metadata Extraction
* Multi-Catalog Support for Data Sources Like Presto
* Enable Cassandra Data Source
* Use a Custom Attribute map for SAML Configuration
* Wrap Text Fields in Quotes for Export and Download
* Reset LDAP Bind Password Using CLI
* Enable or Disable Query Scheduling
* Update Allowed HTML Styles
* Updating Object Mentions
* Control Left-Hand Navigation Bar Behavior
* Disable Role Selection for SSO-Enabled Data Sources
* Extract the Complete View Definition for Google BigQuery
* Customize Search Filters
* Runbook for Administrators
* Your Runbook
* Alation Architecture
* Alation Actions
* Monitoring Alation
* Alation APIs
* Authenticate API Calls with OAuth 2.0
* How-tos
* How to Rebuild Search Index Without Downtime
* How to Find Data Source ID
* How to Set Up LDAP Group Sync with SAML Authentication
* How to Configure a List of Allowed File Types for Article Attachments
* How to Scan Postgres For Corrupted Indexes
* How to Clean up Postgres 9.3 Data
* How to Free Memory
* How to Mount Data Volumes on New Virtual Instances
* How to Enable X-Frame-Options Settings
* How to Convert Usernames
* How to Connect to the Customer Portal
* How to Set Stored User Credentials for Data Sources to Expire
* How to Change the Database Password
* AWS Instance Preparation
* How to Reinitialize Alation Without Re-Install
* Move the Alation Database to AWS RDS
* How to Uninstall Alation
* Troubleshooting
* Logs Overview
* Stopping and Starting Alation
* Troubleshoot Data Dictionary Download and Upload
* 2023.3.x Upgrade Fails Due to Postgres Not Starting
* Reset ETL Checkpoint for the RDBMS Tables
* Fix Job Schedules after 2022.3 Upgrade
* Duplicate User Found
* MDE from Snowflake Data Source Fails with “Error Message: ‘name’”
* Data Policies are Not Extracted into Policy Center
* Troubleshooting Alation Analytics V2 Upgrade to 2021.4
* Elasticsearch Is Not Starting After Update to 2021.4.4
* RPM Installation Error During Update
* Error 500 After Updating
* Default Server Health Alerts
* Configure Server Health Alerts for Administrators
* How to Reindex Tables after Backup Restore
* How to Uninstall Desktop Compose
* Scheduled Queries and Daylight Saving Time
* Mac Excel 16 Crashes when Refreshing Data from Excel Live Report
* Query Log Ingestion Failure Diagnosing
* Troubleshooting Network Issues
* Alation is Not Accessible to Users
* Data Disk is Full
* Root Disk is Full
* Alation Repair Tool
Release Information
* Release Notes
* Release Notes 2024.1 (General Availability)
* Release Notes 2023.3 (General Availability)
* Release Notes 2023.1 (General Availability)
* Release Notes 2022.4 (General Availability)
* Release Notes 2022.3 (General Availability)
* Release Notes 2022.2 (General Availability)
* Release Notes 2022.1 (General Availability)
* Release Notes 2021.4 (General Availability)
* Release Notes 2021.3 (General Availability)
* Release Notes 2021.2 (General Availability)
* Release Notes 2021.1 (General Availability)
* Release Notes 2020.4 (General Availability)
* Release Notes 2020.3 (General Availability)
* Support Matrices
* Version 2024.1
* 2024.1 OCF Connectors
* 2024.1 Native and Custom DB Connectors
* 2024.1 System Matrix
* Version 2023.3
* 2023.3 OCF Connectors
* 2023.3 Native and Custom DB Connectors
* 2023.3 System Matrix
* Version 2023.1
* 2023.1 OCF Connectors
* 2023.1 Native and Custom DB Connectors
* 2023.1 System Matrix
* Version 2022.4
* Version 2022.3
* Version 2022.2
* Version 2022.1
* Version 2021.4
* Version 2021.3
* Version 2021.2
* Version 2021.1
* Version 2020.4
* Version 2020.3
* Version V R7 (5.12.x)
* Version V R6 (5.10.x)
* Version V R5 (5.9.x)
* Version V R4 (5.8.x)
* End Of Support
* Alation End of Support Matrix
* Snowflake Parser Add-On
* Snowflake Column-Level Lineage 2021.4
* Important Notices and Security Alerts
Archived Documentation
* About the Documentation Archive
* Administration and Update Archive
* Alation Sandbox
* Overview of the Alation Sandbox Program
* Install Alation Sandbox
* Configure Access to Backups on Amazon S3
* Configure Sandbox
* Run the Sandbox Executable
* Resume Sandbox Run
* Update Sandbox Configuration Parameters
* Sandbox FAQ
* Scarlet Installation and Configuration
* Cloud Sandbox
* Enabling Agile Approval
* Enable Hat Switching
* Enable Integration with Swagger (OAS 3.0 API Specifications)
* Enable the Viewer Role
* How to Exclude Postgres Backup from Alation Backup
* How to Migrate Logical Data to GBM
* How to Restart Celery-Beat to Trigger the First ETL for Analytics
* Labs
* Managing Users - before V R7 (5.12.x)
* Object Equivalences Tab
* Reset LDAP Bind Password Using CLI (version 4.5—5.4)
* Troubleshooting Advanced Search
* Users Tab
* Release Notes Archive
* Archived Version 4 Release Notes
* Release Notes 4.0.0
* Release Notes 4.1.0
* Release Notes 4.2.0
* Release Notes 4.3.0
* Release Notes 4.4.0
* Release Notes 4.5.0
* Release Notes 4.6.0
* Release Notes 4.7.X
* Release Notes 4.8.X
* Release Notes 4.10.X
* Release Notes 4.11.X
* Release Notes 4.12.0
* Release Notes 4.13.0
* Release Notes 4.14.x
* Release Notes 4.15.0
* Release Notes 4.16.0
* Release Notes 4.18.x
* Release Notes 4.20.x
* Archived Version V Release Notes
* Release Notes V R1 (General Availability)
* Release Notes V R2 (General Availability)
* Release Notes V R3 (General Availability)
* Release Notes V R4 (General Availability)
* Release Notes V R5 (General Availability)
* Release Notes V R6 (General Availability)
* Release Notes V R7 (General Availability)
* Release Notes V R4 5.8.1 (Limited Availability)
* What’s New in Alation V
* Usage and Customization Archive
* Alation Analytics V1
* Working with Alation Analytics
* Analytics Metadata Descriptions
* Analytics ETL on Demand
* Alation Analytics UUID
* Object Query Maker
* Alation Analytics QUERY INDEX
* Alation Analytics Sample Queries
* Articles Audit
* Queries Audit
* Compose Analytics
* Contribution Summary by Group
* Alation Analytics Object Queries
* Alation Analytics Article Fields
* Active and Inactive Users
* Compose Query Each Day
* Stewards, Titles, and Descriptions Tables
* Attribute Values
* Articles From the Last 30 Days
* Tables in Alation with Pivot
* Who Has Accessed Alation?
* Table Titles and Descriptions
* Object Visits
* Server and Catalog Administrators
* Shared Queries
* Objects by Number of Users Visiting
* Specific Object Fields
* Tableau Object Visits
* Article Visits
* All Stewards
* All Objects With and Without Stewards
* Data Source Names
* Flagging Activity
* All Tableau Objects
* Full Data Dictionary
* Top Users by Page Visits
* Curation progress (Titles and Descriptions Only)
* All Tableau Workbook Attributes
* Alation Analytics V1 Shows Deleted Tables and Columns as Existing
* Customizable Homepage
* Configure the Homepage - V R4 to V R7
* Customize Homepage JSON - V R4 to V R7
* Troubleshoot Homepage Customizations V R4 to V R7
* Design Homepages to Make a Good First Impression
* Hats in Alation
* Using Advanced Search
* How to Search
* Searching and Filtering
* Add Tableau Sources on Legacy Framework
* Migrate Catalog Data to a New Tableau Source on Generic Model
* Tableau Source Feature Flags
* Alation User Survey
* Creating a New Glossary
* Naming Data with Lexicon
* Improve the Lexicon
* Metadata Change Log
* Viewing Articles in the Business Glossary View
* Work with the Lexicon - Versions up to 2020.4.x
Alation User Guide
Docs > Release Notes > Release Notes 2023.3 (General Availability)
RELEASE NOTES 2023.3 (GENERAL AVAILABILITY)¶
Note
The release notes on this page reflect changes to the Alation application. If
you’re looking for OCF connector release notes, jump to Open Connector Framework
(OCF) Release Notes.
RELEASE 2023.3.5.2¶
build 17.5.2.73574
Released April 26, 2024
Note
This release is available for customer-managed (on-premise) Alation instances.
* Addressed an issue of performance degradation during search data ingestion.
This issue was caused by a recently added attribute in one of the functions
that led to a large number of unnecessary queries against the Alation
database. The issue was addressed by query optimization and enhanced caching.
(AL-154844)
RELEASE 2023.3.5.1¶
build 17.5.1.68029
Released March 11, 2024
Note
This release is available for customer-managed (on-premise) Alation instances.
* Resolved a deadlock issue in uWSGI worker threads introduced by the upgrade
from Python 3.6 to Python 3.9. The deadlock occurred when threads loaded a
Django application alongside the Python module traceback. The issue was
addressed by disabling traceback by default. (AL-145955)
* Fixed an issue in the rosemeta_allvisits table where updates for conversation
visits were not accurately reflected. Enhanced the logging mechanism for
tracking visits to the conversation page in the public.visits table within
Alation Analytics. This fix ensures that all user visits to conversations are
properly logged and updated. (AL-142986)
RELEASE 2023.3.5¶
build 17.5.0.64295
Released February 6, 2024
> Note
>
> This release is available for all Alation instance types: customer-managed
> (on-premise) and Alation Cloud Service.
* The Connect Platform
* Alation Public APIs
* Search
* Navigation
* User Management
* Renaming of Glossary Terms Feature Flags
* OCF Connectors
* Bug Fixes
THE CONNECT PLATFORM¶
CATALOG VISIBILITY MANAGEMENT FOR BI SOURCES¶
To provide better control over who can view BI sources in the catalog, we’ve
introduced the ability to manage catalog visibility for BI sources and a
function of the BI Server Admin, similar to that of the Data Source Admin for
RDBMS data sources. Users with the Server Admin role can grant the BI Server
Admin access to themselves and other users. A BI Server Admin can access the
settings of a BI source and configure its visibility on the new Access tab:
> * Public BI Server—Visible to all catalog users
>
> * Private BI Server—Visible to specific catalog users or groups designated by
> a BI Server Admin
By default, a newly created BI source is public. (AL-124106)
AWS PRIVATELINK SUPPORT FOR AMAZON S3 OCF SOURCES¶
Alation Cloud Service on Cloud-Native Architecture
AWS PrivateLink connections are now supported from the Amazon S3 OCF connector
to an S3 bucket located in the customer’s VPC for VPC’s in the same AWS region.
(AL-118070)
ALATION AGENT POLLING MODE¶
Alation Cloud Service on Cloud-Native Architecture
Alation Agent can now be configured to use polling. In the polling mode, users
will see an informational message that some operations may take longer time to
finish. The Agent dashboard in Admin Settings > Manage Connectors will indicate
whether the Agent is configured to use the standard or the polling mode.
(AL-138169)
ALATION PUBLIC APIS¶
ACCESS TO THE CUSTOM FIELD VALUE API FOR CATALOG ADMINS¶
Alation users with the Catalog Admin role can now use the Custom Field Value API
endpoints. (AL-140940)
ABILITY TO MANAGE BI SOURCE VISIBILITY VIA API¶
You can now make BI servers private or public when creating a BI server and
updating a BI server with the API. When getting a BI server, the response
indicates whether the server is private. This API accompanies the new feature
Catalog Visibility Management for BI Sources. (AL-142964)
NEW API TO MANAGE DATA SOURCE CONNECTIONS FOR A BI SERVER SOURCE¶
Added new API endpoints allowing users to get, create, update, and delete the
data source connections information for a BI server source. (AL-141305)
TERMS API CAN FILTER BY GLOSSARY AND PROVIDES MORE INFO¶
When retrieving terms via API, you can now filter terms by which glossary they
belong to. The response includes which glossary the terms belong to, any custom
fields associated with the term, and the ID of the term’s template. (AL-111871)
FIXES TO DATA DICTIONARY API AND ARTICLES API¶
* Fixed a bug in the Data Dictionary API where a trailing slash was included in
the documentation for the GET endpoint, which was causing API calls to fail.
(AL-142026)
* The Articles API now returns the correct error code (401) when a call is made
with an invalid token. Previously it returned the 403 error code. (AL-134789)
SEARCH¶
FILTERING BY CATALOGS¶
We’ve introduced a new search facet Catalog that can be used to filter metadata
by the catalog object. The Catalog facet is applicable to schemas with multipart
names (“catalog.schema”), such as Google BigQuery. Users with the Server Admin
and Catalog Admin roles can add the Catalog facet to the left-hand filter panel
in Admin Settings > Catalog Customization > Customize Search Filters.
(AL-122598)
NAVIGATION¶
CONTROL USERS’ ABILITY TO SELECT PREFERRED HOMEPAGES¶
Server Admins now have the capability to control whether or not catalog users
can select their preferred homepages. We’ve added a new feature flag
alation.feature_flags.homepage.enable_admin_assigned_homepage to alation_conf to
control the ability for users to set a preferred homepage from the My Account
menu.
> * By default, the flag is set to True, which means only administrators assign
> homepages to users.
>
> * When the flag is set to False, users will have the ability to designate a
> preferred homepage.
The feature flag provides organizations with flexibility to determine if they
want users to select from and work with multiple homepages. (AL-145020)
USER MANAGEMENT¶
USER SIGN-UP MODERATION ENABLED BY DEFAULT¶
Previously, user sign-up moderation was disabled by default on customer-managed
and Alation Cloud Service instances that are not on the cloud-native
architecture. From this release onward, user sign-up moderation is enabled by
default on all new installations, both customer-managed and Alation Cloud
Service, and on the cloud instances that are newly migrated to Alation Cloud
Service on the cloud-native architecture.
On subsequent upgrades, the user sign-up moderation setting will be preserved.
> Important
>
> If your current instance is customer-managed or an Alation Cloud Service
> instance that hasn’t been migrated to the cloud-native architecture yet and
> you have never changed your user sign-up moderation preferences, then expect
> this setting to become enabled by default after updating to 2023.3.5.
>
> If you’ve changed this setting before, your previous configuration will be
> preserved.
We recommend that user sign-up moderation should be enabled by default on all
instance types to adhere to security best practices. Please review your user
sign-up moderation settings after updating to 2023.3.5 and update the setting as
per your organization’s policies. You can find the user sign-up moderation
settings under Admin Settings > Authentication > User Signup Moderation
Preference. (AL-141813)
SCIM INTEGRATION ENHANCEMENTS¶
We introduced a new read-only attribute groups in the GET request response to
the SCIM user detail request. The SCIM user endpoints for retrieving either a
list of users or a specific user will now return the group information in the
response as a read-only attribute. This makes Alation’s SCIM API compliant with
RFC 7643 and allows supporting custom-developed workflows that rely on this
attribute. (AL-140681)
RENAMING OF GLOSSARY TERMS FEATURE FLAGS¶
In preparation for the public preview of the Documentation Hub feature that is
coming up in the major 2024.1 release (March 2024), the feature flags enabling
the Glossary Terms feature have been renamed in Admin Settings > Feature
Configuration:
> * Glossary Terms Setup has been renamed to Document Hubs 1: Setup (disabled
> by default)
>
> * Glossary Terms GA has been renamed to Document Hubs 2: Show Glossary Hub
> (disabled by default)
>
> * Glossary Terms Performance has been renamed to Improvement Document Hubs 4:
> Performance Improvement (enabled by default)
>
> * Glossary Terms Total Count has been renamed to Document Hubs 5: Document
> Total Count (disabled by default)
In addition, there is a new feature flag Document Hubs 3: Enable Hub Creation
(Public Preview) (disabled by default). Customers are not advised to enable this
feature in 2023.3.5. The enablement guidelines will be available with the
Document Hub Public Preview information. (AL-133300)
OCF CONNECTORS¶
Updates to the Open Connector Framework (OCF) connectors are released every
week. See Open Connector Framework (OCF) Release Notes for detailed information
on the connector updates in the month of January 2024.
Some January highlights include:
NEW CONNECTOR RELEASES¶
> * Fivetran add-on OCF connector (GA)
>
> * Kafka OCF connector (public preview)
>
> * Mongo DB OCF connector (public preview)
CONNECTOR SETTINGS USER EXPERIENCE REDESIGN¶
We’ve completely redesigned the user experience for Alation admins setting up
OCF sources for the connectors listed below. Now, the configuration parameters
are organized by steps, with new validation features added, such as testing
connection and permissions to access the metadata. The extraction process has
been fortified, and more clarifications and troubleshooting tips are now
available in the user interface in case of extraction or ingestion errors.
> * Google BigQuery OCF connector
>
> * Oracle OCF connector
>
> * Databricks Unity Catalog OCF connector
>
> * Redshift OCF connector
OTHER UPDATES¶
CROSS-DATA-SOURCE LINEAGE FOR MICROSTRATEGY BI SOURCES¶
Previously, only BI lineage was supported by the MicroStrategy OCF connector.
Cross-system table-level lineage was not supported due to unavailability of the
host and port information via the MicroStrategy REST API. As a result, Alation
couldn’t trace a report or document back to the upstream data source.
Now, we leverage the Alation API to input host and port for the data sources
where it is not available via the MicroStrategy API, providing end-to-end
table-level lineage for in-memory cubes.
OCF TABLEAU ENHANCEMENTS¶
Native to OCF migration is available for Tableau sources:
> * The migration is enabled through both the user interface and a curation
> migration script.
>
> * The script now has improved logging.
OCF ORACLE E-BUSINESS SUITE 12.2.12 CERTIFICATION¶
The OCF connector for Oracle has been quality-certified for Oracle E-Business
Suite version 12.2.12. (AL-133313)
ALATION AGENT CERTIFICATION WITH COMPOSE FOR MORE CONNECTORS¶
Compose is now available for the following connectors installed on Alation Agent
(AL-139438):
> * OCF connector for Impala on CDH
>
> * OCF connector for Impala CDP
BUG FIXES¶
DATA DICTIONARY¶
* Fixed an issue where the field editing history is not updated when a user
updates fields using a data dictionary upload. Now, the field editing history
for a field appears in the catalog after uploading the data dictionary.
(AL-141644)
* Previously, while parsing the data dictionary header, the grammar was
restricted to only ASCII characters, so Unicode characters were rejected by
throwing an error message. We have fixed this behavior by modifying the
grammar to include Unicode characters too. For example, now the upload data
dictionary feature works for Japanese characters and other Unicode
characters. (AL-141572)
* Fixed an issue where the data dictionary upload using a CSV file failed in
the Firefox browser with the error Invalid file format. Only CSV or TSV files
are supported. Now, users can upload both TSV and CSV data dictionary files
on any version of Firefox, Chrome, and other supported browsers. (AL-141001)
ALATION ANALYTICS¶
* Increased the consumer timeout for RabbitMQ to two hours to ensure that ETL
does not truncate large tables. (AL-135579)
* Any flag object extracted into Alation Analytics from the Alation database
with the is_for_temp_object column set, will be skipped by the queries. Going
forward, we are excluding temporary objects from being stored in Alation
Analytics as they do not reference objects stored in the Alation database.
(AL-135191)
* Ensured that Alation Analytics now does not use the Docker 4.7 update
instructions alone in Dockerfiles by updating the base image to use a newer
version of RHEL 8 which doesn’t have the update command alone as instruction.
(AL-133173)
* Added a new column groupprofile_id to the alation_group table. This table
will hold the ID of the group profile related to the authentication group.
This will ensure consistency between Alation Analytics and the custom fields
in the catalog UI, like the Steward field. (AL-128206)
* Fixed the issue that caused the following error during ETL: Failed to insert
records into stg_bi_datasource_columns due to psycopg2 error: null value in
column “bi_ds_fp” of relation “stg_bi_datasource_columns” violates not-null
constraint. Added a not-null constraint to the bi_ds_fp column in the
(stg_)*bi_datasource_columns table. (AL-127789)
* Added support for null values in the ts_started, ts_updated, and other fields
to prevent failures of the ETL job StewardshipBulkActionTransformJob.
(AL-137837)
GOVERNANCE¶
* Fixed an issue causing pod eviction. Optimized memory usage by the Celery
service of the downstream MDE jobs for OCF Snowflake data sources that
handles ingestion of Snowflake tags and tag links. (AL-140666)
* Fixed an issue where workflow reviewers were unable to suggest changes,
receiving an error message: Your suggestion couldn’t be created at this time.
The feature is disabled or you do not have sufficient permissions.
(AL-133561)
* Fixed an issue where an initial extraction from a BI source did not display
some of the extracted reports in the user interface, with those reports
appearing in the catalog automatically a few days later. The issue was caused
by a Celery queue for long-running tasks. Addressed by optimizing how
processing queues are organized for long-running stewardship tasks.
(AL-127200)
* Optimized the downstream jobs that run during MDE for OCF Snowflake data
sources. In addition, the job that handles the clean-up of deleted Snowflake
tags will now skip the deletion of the Snowflake tag custom field if the new
alation_conf flag
alation.feature_flags.disable_snowflake_customfield_deletion is enabled
(disabled by default). This change decreases memory usage during MDE and
shortens MDE duration. (AL-140666)
OTHER FIXES¶
* Fixed an issue that prevented the installation and upgrade on FIPS-enabled
operating systems. (AL-135158)
* Fixed an issue where the user moderation setting became enabled after each
Alation upgrade since migrating the instance to the cloud-native
architecture. Now, the preference set by a Server Admin will be preserved.
(AL-137401)
* Addressed a security vulnerability in the Golang packages by upgrading to
their latest version. (AL-143662)
PATCH RELEASE 2023.3.4.1¶
build 17.4.1.63336
Released January 24, 2024
> Note
>
> This patch release is for Alation Cloud Service instances on the cloud-native
> architecture.
This patch includes enhancements to the Alation Analytics offering on the
cloud-native architecture. It isn’t universally available in all AWS regions. If
your Alation Cloud Service instance is not planned for this update, the patch
may not be applicable to your instance. (AL-139775)
RELEASE 2023.3.4¶
build 17.4.0.60909
Released January 4, 2024
Note
This release is available for all Alation instance types: customer-managed
(on-premise) and Alation Cloud Service.
ALATION ANYWHERE¶
ALATION ANYWHERE FOR MICROSOFT TEAMS (CLOUD NATIVE ARCHITECTURE ONLY)¶
Microsoft Teams application users can now unfurl a conversation link from
Alation. Users can quickly start a new conversation from Microsoft Teams per a
specific object, reply to a conversation, or mark the conversation as resolved.
(AL-124015)
ALATION ANALYTICS¶
ALATION ANALYTICS DASHBOARD IMPROVEMENTS¶
* On the ETL Status Dashboard an admin can mark all the ETL failure messages as
read using the Mark all as read button. In addition, an admin can refresh the
ETL Status Dashboard without reloading the tab using the Refresh Table
button. (AL-138679)
* On the Top Contributors Dashboard, if a user no longer exists in Alation but
does exist in the Alation Analytics data source, then an asterisk will be
appended to the user’s name in the Top Contributors Dashboard. (AL-138679)
ENABLE THIRD-PARTY METRICS IN ALATION¶
Naming and default values for feature flags that enable outgoing requests to
Pendo and other third-party analytics tools have been made more consistent. This
is enabled by default. Each third-party analytics tool has a dedicated feature
flag that customer admins can enable or disable from the feature flags admin
page. (AL-140552)
ALATION ANALYTICS BACKUP AND RESTORE IMPROVEMENTS¶
Improved overall performance of Alation Analytics backup and restore.
(AL-133755)
IMPROVEMENTS TO ALATION ANALYTICS FOR BI ACCESS¶
* Fixed an issue where the initial Alation Analytics data replication to
Snowflake failed for certain tables which had the NULL value among the values
in the array-type columns. (AL-133055)
* The script copy_data_to_snowflake.py now accepts the arguments which can be
used to copy only the required tables. The time_period table is now also part
of the initial data copy process to Snowflake. (AL-141482)
COMPOSE IMPROVEMENTS¶
Ensured that the Compose Desktop menu item Visit Help Center Cloud Authorization
redirects to the help center page as intended. (AL-137205)
CLOUD AUTHORIZATION¶
SCIM TOKEN GENERATION WARNING¶
Users will now receive a warning before generating a new SCIM token when a
previous token already exists (expired or not). The warning will indicate that
the previous token will be invalidated. (AL-138329)
DATA DICTIONARY IMPROVEMENTS¶
Upload Data Dictionary improvements include: (AL-138675) - You can now link
Terms and Policies to data objects using Upload Dictionary. Terms and Policies
links will also be downloaded in the object set field as part of the data
dictionary file.
* Period characters are now supported. The downloaded dictionary will have
key_name quoted as required by the upload feature when names contain a period
character.
* Non-admin users can now access upload dictionary without a page refresh.
* Enhanced object reference presentation in the data dictionary preview table.
Previously, the title appeared as the text of the link within the object
reference column. Now, when the key is available, it displays as link text;
however, if the key is unavailable, the object’s title will be shown as text
in the link.
* Data Dictionary preview is now able to render fields with a comma in names.
GLOSSARY AND ARTICLES¶
Users will now see the Stewards field on all Glossary details pages. (AL-133299)
GOVERNANCE IMPROVEMENTS¶
Policy ingested timestamp for policies that were ingested using the Native
Snowflake Connector will be back-filled with the created timestamp. (AL-138443)
GROUP-BASED HOMEPAGES¶
Catalog admins can assign a homepage to one or more user groups. (AL-134390)
* Users that are part of the assigned group(s) that have a homepage will be
able to view this homepage when they log in to the application.
* Users that are already using role-based homepage associations will
automatically be migrated to the group-based scheme.
* If a user is part of multiple groups that have different homepages assigned,
the user will be able to choose a preferred homepage.
* When a user is not part of any group that has a homepage assigned or they
haven’t chosen a preferred homepage, they will be shown the Alation default
homepage.
SEARCH ENHANCEMENTS¶
Automated the task to analyze and update search index data. The task is
configurable using alation_conf (to enable, disable, and schedule the task).
(AL-129324)
APIS¶
OCF DATA SOURCES API COMPOSE SUPPORT¶
Enhanced the API to be able to set up compose for data sources using OCF
connectors. (AL-130098)
BUG FIXES¶
CLOUD AUTHORIZATION: BYPASS USER EMAIL CONFIRMATION FOR SSO-BASED AUTHENTICATION
FLOWS¶
A recent update from Python 3.6 to 3.9 caused empty passwords to be handled
differently; as a result, users or requests provisioned in the system without a
password and not a confirmed email address were redirected to the verify email
page even if the password is not required for those users (like in the case of
SCIM). Now the system will set non-empty passwords for all the users during the
user creation flows to ensure that users won’t get redirected to verify their
email if they are not password users. (AL-139068).
GLOSSARY AND ARTICLES¶
Removed an errant “b” that was prepended to the title slug in Article URLs.
(AL-138356)
KVSTORE IMPROVEMENTS¶
Some users are affected by a memory hike on the KVstore and need to regularly
reboot KVstore. The KVstore has been upgraded to 8.3.2 and will now consume less
memory. (AL-142108)
PATCH RELEASE 2023.3.3.2¶
build 17.3.2.58486
Released December 13, 2023
Note
This release is available for customer-managed (on-premise) Alation instances.
* Fixed an issue that prevented users from connecting to their OCF Impala data
sources in Compose after transitioning from the Hive driver to the Cloudera
Impala driver within the CDP connector. The corresponding driver in Compose
was updated accordingly. Users can now connect and run queries as previously
experienced. (AL-138914)
PATCH RELEASE 2023.3.3.1¶
build 17.3.1.58212
Released December 5, 2023
Note
This release is available for Alation Cloud Service instances on the
cloud-native architecture.
* Fixed a bug where a new Python-based wrapper script that was implemented to
support additional Datadog features caused a bug which resulted in no logs in
Datadog from any of the affected clusters. Now, the log availability in
Datadog has been restored. (AL-140466)
RELEASE 2023.3.3¶
build 17.3.0.57463
Released December 4, 2023
Note
This release is available for all Alation instance types: customer-managed
(on-premise) and Alation Cloud Service.
COMPOSE¶
PAST SCHEDULED EXECUTIONS DASHBOARD FOR ADMINS¶
A new dashboard is now available as a second tab next to the existing scheduled
query admin dashboard that provides a tabular view of past scheduled executions.
This feature aims at helping Server Admins understand the patterns of scheduled
queries on their instance. They will be able to monitor if any schedules fail,
take significant execution time, or were canceled. (AL-128832)
IMPROVED QUERY EXPORT SCALABILITY¶
Previously, the Run and Export actions sometimes failed for smaller exports and
consistently failed for exports of over 1M records. The Run and Export
functionality should now be stable for both small and large exports. (AL-125680)
DATA DICTIONARY IMPROVEMENTS¶
* Introduced the feature flag
alation.feature_flags.disable_perm_check_on_download_dd to disable permission
checks when downloading data dictionaries. Permission checks may take a
significant amount of time, which in some cases can delay the delivery of the
download URL to users by a few hours. This flag allows disabling the
permission checks from the backend. By default, the flag is set to False,
which means the Download Dictionary feature will check the permissions and
the download option will be available for users with the Composer role and
above. Setting this flag to True will disable the permission checks and the
Download Dictionary option will only be visible to Catalog Admins and Server
Admins. (AL-138107)
* Data Dictionary download now includes a new column,
al_datadict_column_data_type, which contains the data type for each column.
This information was previously contained in the al_datadict_item_properties
column, but has now been broken out on its own. This column should be
considered read-only.
* Added support for custom field names in upper or mixed case in the data
dictionary file. (AL-137003)
* Added support for custom field names with a comma in headers. (AL-138310)
* A summary is now displayed for the uploaded dictionary on the Upload
Dictionary screen after the upload dictionary process is completed.
(AL-136514)
* The data dictionary upload now accepts the TSV file format. (AL-136379)
* Previously, we relied on object keys (names) to link objects using object set
fields in the upload dictionary flow, which caused some performance
challenges and issues identifying the right objects in case of duplicates. To
address this, we added support for the object ID in the format objectid |
ObjectKey(name). You can now provide the object ID or the name or both to
link objects via the dictionary upload. When downloading the data dictionary
file, we will include both the object id and the object key for each object
set field value. (AL-127462)
ALATION ANALYTICS¶
* Added a “no special characters” password policy for the Alation Analytics
database password: the password can’t contain any special characters.
(AL-138780)
* Now you can skip load tables from the subsequent ETL runs using a new
alation_conf flag alation_analytics-v2.etl.skip_load_tables. This setting can
unblock all other ETL jobs if some jobs are failing. To add tables to this
flag, use the following syntax: alation_conf
alation_analytics-v2.etl.skip_load_tables -s '["users", "query"]'. To reset
the flag, use the following syntax: alation_conf
alation_analytics-v2.etl.skip_load_tables -s '[]'. (AL-128081)
* Cloud-native architecture The alationanalyticsv2_entitlement_counts table has
been renamed to license_usage to more accurately describe its purpose.
Additionally, the following measures related to user license consumption have
been added to the table:
* num_licenses—The number of licenses available.
* pct_utilization—The number of users as a percentage of available licenses.
* pct_adoption—The number of active users as a percentage of available
licenses.
This table is also now replicated to Alation Analytics on Snowflake.
(AL-136878)
> Note
>
> The license_usage table is populated on Alation instances on Cloud-native
> architecture only. On customer-managed instances, this table is present but
> not populated.
GLOSSARY IMPROVEMENTS¶
The enable_glossary_terms_performance feature flag, which controls the
performance enhancement for Glossaries, now defaults to enabled. The flag still
remains in the flag list on the Feature Configuration page. If you had
previously toggled it on and then off again, it will remain disabled after the
upgrade to 2023.3.3. You can manually toggle it back on again to experience a
performance improvement. (AL-136812)
ABSOLUTE USER SESSION TIMEOUT (CLOUD-NATIVE ARCHITECTURE ONLY)¶
For security reasons, users will no longer be able to stay logged in for an
indefinite period of time. A user session will be terminated forcing the user to
re-login once the time limit for session duration is reached. The absolute user
session timeout is configurable on the Authentication page of Admin Settings, in
the Session Timeout Settings, using the field Maximum Session Duration (in
hours). This feature applies only to customers on the cloud-native architecture.
(AL-123328)
ALATION API¶
CUSTOM FIELD VALUE APIS¶
* Added support for api_resource, api_resource_field, and api_resource_folder
object types in the Public Custom Field Value API and Public Custom Field
Value Async API (Refer to Custom Field Value Overview on Alation Developer
Portal). (AL-134107)
* Fixed an issue with the Public Custom Field Value API where validation errors
were not thrown correctly when using an unsupported object type (AL-134176).
PUBLIC API FOR SCIM TOKEN GENERATION¶
* Added support for the API endpoint for SCIM token operations (Refer to SCIM
2.0 API on Alation Developer Portal). (AL-136805)
CLOUD INFRASTRUCTURE¶
Cloud-native architecture
* Re-enabled the admin UI for viewing active tasks which was previously
disabled when this service launched due to some issues. (AL-124848)
* The License dashboard page now shows the contract expiration date.
Previously, the license expiration date was displayed. In Alation, licenses
are renewed every year until the contract expires. (AL-137415)
* Elasticache is now in use on instances on the cloud-native architecture.
Alation components leveraging Elasticache have better performance by storing
and retrieving frequently used data within Elasticache. (AL-107135)
BUG FIXES¶
* Fixed an issue where after the upgrade to 2023.3.1, the query forms user
experience for the Viewer role was hampered when the Obfuscate Literals
setting was enabled (all literals became unavailable in the query form
result). This fix returns query forms behavior to align with the behavior in
Compose where a user with run (or edit) permissions on a query would see
literals, even when literal obfuscation is turned on, as opposed to a viewer
who would not see the literals. A user with only view permissions on a query
would not see literals on any Alation page when obfuscation is turned on.
(AL-136260)
* Fixed an issue when the dynamic multi-select widget did not show any error
messages on query forms. (AL-137032).
PATCH RELEASE 2023.3.2.2¶
build 17.2.2.66531
Released February 28, 2024
Note
This release is available for customer-managed (on-premise) Alation instances.
* Resolved a deadlock issue in uWSGI worker threads introduced by the upgrade
from Python 3.6 to Python 3.9. The deadlock occurs when a thread attempts to
load a Django application alongside the Python module traceback. The issue
has been addressed by disabling traceback by default. (AL-145955)
PATCH RELEASE 2023.3.2.1¶
build 17.2.1.55993
Released November 8, 2023
Note
This release is available for all Alation instance types: customer-managed
(on-premise) and Alation Cloud Service.
* This patch release includes platform updates to support the enhanced user
experience for configuring OCF connector settings, which will be available in
upcoming connector releases, starting with the Snowflake OCF connector.
(AL-137533)
* Fixed a Bulk Utility issue where an internal .csv file would become corrupted
when users clicked the Download button on the Bulk Utility page. This issue
occurred where the initial use of the Bulk Utility involved clicking Download
as opposed to selecting a specific saved search, resulting in the generated
.csv file missing the Search column and leading to a 500 error. (AL-136141)
RELEASE 2023.3.2¶
build 17.2.0.55403
Released November 1, 2023
Note
This release is available for all Alation instance types: customer-managed
(on-premise) and Alation Cloud Service.
ALATION ANALYTICS¶
BASIC AUTHENTICATION FOR RABBITMQ¶
The RabbitMQ component of Alation Analytics now requires basic authentication
for incoming connections from other Alation components. The RabbitMQ password is
auto-generated during the installation or upgrade of Alation Analytics. The
password needs to be set in alation_conf via the
alation_analytics-v2.rmq.config.password parameter before initializing the
Alation Analytics database.
This is a one-time setup for customer-managed instances of Alation. Alation will
perform this setup for Alation Cloud Service customers.
OBJECT AND USER COUNTS¶
Object and user counts are now stored in Alation Analytics in the
alation_analytics_v2_entitlementcounts table. The table is updated daily with a
snapshot of all object usage across an Alation instance.
> Note
>
> For Alation Analytics Snowflake users: This data is not replicated into
> Snowflake in this release, but it will be synced starting from the next
> release (the November release).
IMPROVEMENTS FOR THIRD-PARTY BI ACCESS VIA SNOWFLAKE¶
Cloud-native architecture
SNOWFLAKE PASSWORD REQUIREMENTS ENFORCED¶
If you have a connected Alation Analytics database in Snowflake, your Alation
Analytics password must meet Snowflake’s password requirements. This is now
enforced in the Alation user interface under Account Settings > DB Connections.
To create or update the password for the Alation Analytics data source, users
will need to follow certain password policies imposed by Snowflake (a lowercase
alphabet, an uppercase, a digit, and the length of eight characters).
CLEAR ANALYTICS DATA - FIXED¶
The Snowflake database was not getting cleared when clearing up Alation
Analytics using the Clear Analytics Data button. Now, the cleaning up of the
database will be done asynchronously as part of a Celery task, and the button
click will post a message to Celery and return success. (AL-125158)
ALATION ANYWHERE¶
Alation Anywhere for Slack now shows rich previews for glossaries and terms.
AUTHENTICATION¶
We have updated and expanded audit logging for important security-related
events, such as updates to authentication settings, authorization changes, and
user and group management updates. Authentication logs are written to
alation-events.log.
COMPOSE ENHANCEMENTS¶
* You can now sort queries alphabetically by name in ascending and descending
order.
* Compose now deletes blank queries after closing the query tab. In addition,
on Sunday, Compose automatically deletes any blank queries from the past
week.
* Embedded queries can now be executed in query forms.
* When query results are exported or downloaded in any way, Alation logs the
event for auditing purposes. The logs are recorded to the alation-events.log
file.
* Fixed an issue where the Connection Settings dialog didn’t open when
attempting to run a query with a connection error.
* The Query API now respects configuration settings that prevent query results
from being exported or downloaded.
* Multi-select parameters in query forms can now have their value options
defined with a pre-query. Once the pre-query has been run, query form users
can select values based on the results of the pre-query. For usability
purposes, pre-query results have an upper limit of 100 result items.
CONNECTED SHEETS OAUTH ENHANCEMENTS¶
* Roles are kept separate for the username and SSO credentials so users will
not see roles auto-populated inconsistently between the different credential
forms.
* Error messages have been moved to the top so that they are visible without
having to scroll.
* A “Connected” badge was added showing the credential that is being used.
* The credentials form now automatically expands and collapses.
GOVERNANCE¶
Data Dictionary upload has a new, streamlined interface and now runs
asynchronously. Users should avoid quoting header names containing space
characters to avoid issues with well-known CSV editors.
Data Dictionary download now includes a new first column,
al_datadict_item_properties, which contains object types and object IDs for each
object in the data dictionary. When updating an RDBMS object with a data
dictionary, this column should not be modified. When migrating curation
information from one instance to another, this column should be removed, as the
object IDs may not be correct for the target instance.
INSTALL AND UPGRADE¶
* On customer-managed (on-premise) instances of Alation, you can now place the
internal Alation database on the Amazon Relational Database Service (Amazon
RDS) instance in your own AWS account. This capability provides the benefits
of RDS to self-managed customers.
* Added support for Red Hat Enterprise Linux (RHEL) 9.x, Ubuntu Linux 22, and
Debian Linux 11 as base operating systems for installation of the on-premise
Alation software package.
* The legacy tab—Software Updates—has been removed from Admin Settings.
LINEAGE¶
ASSET GROUPING ICONS FOR DATASOURCE CLUSTER NODES¶
Data source logos are now shown in the Compound Layout lineage diagrams for each
data source group. Generic data source logos are used for virtual data sources
and Custom DBs.
SEARCH¶
SYNONYM SEARCH ON CLOUD-NATIVE ARCHITECTURE¶
Synonym search is now supported in the cloud-native architecture.
NEW PUBLIC API FOR THE MANAGEMENT OF SYNONYMS¶
A new public API has been added for the management of synonyms so that customers
can customize synonym terms in their catalog searches. For more information,
refer to Search Overview on Alation’s Developer Portal.
USER MANAGEMENT: GENERATE SCIM TOKENS IN THE USER INTERFACE¶
Server Admins can now generate SCIM tokens on the Admin Settings >
Authentication page, making it easier to maintain the connection between your
identity provider and Alation. Server Admins will get alerts about SCIM token
expiration. Email alerts will occur 15 days before expiration, 1 day before, on
the day of expiration, and the day after expiration. Server Admins will also see
a banner appear in the Alation interface 15 days before the token expires.
CONNECT PLATFORM¶
ZERO TOUCH AGENT - DOWNLOADABLE INSTALLERS THROUGH PUBLIC API¶
Installer packages for the Alation Agent can now be downloaded programmatically
through the public Alation Agent API.
OCF CONNECTORS¶
HDFS OCF CONNECTOR—NEW!¶
The HDFS OCF connector is now generally available (GA).
MICROSTRATEGY OCF CONNECTOR—NEW!¶
MicroStrategy OCF connector is now generally available (GA). The MicroStrategy
OCF connector supports TLS and other features based on MicroStrategy REST APIs.
SALESFORCE OCF CONNECTOR—LIMITED AVAILABILITY¶
Limited availability release of the Salesforce OCF connector which would be
replacing the custom DB connector.
> * Known issue: The OAuth support for MDE requires manual token refresh upon
> expiration.
BUG FIXES FOR MULTIPLE OCF CONNECTORS¶
* Column profiling: Fixed a profiling error raised when profiling a column with
more than 2,147,483,647 rows (AL-130007). Applies to OCF connectors:
> * AWS Databricks OCF connector
>
> * Azure Databricks OCF connector
>
> * Redshift OCF connector
* The JDBC URI is auto-updated to have useNativeQuery=0 if not given in the
URI. This fixes custom query sampling errors (AL-129772). Applies to OCF
connectors:
> * AWS Databricks OCF connector
>
> * Azure Databricks OCF connector
>
> * Databricks Unity Catalog OCF connector
>
> * Databricks Unity Catalog OCF connector
* Removed the jtds prefix appended in sqlserverazure in the connector code
(AL-134059). Applies to OCF connectors:
> * Azure SQL DB OCF connector
>
> * SQL Server OCF connector
ATHENA OCF CONNECTOR¶
* Getting query string from Batch API using query execution ID. (AL-127679)
* Removed the ORDER BY clause from the column profile queries (stats).
(AL-133322)
AWS GLUE OCF CONNECTOR¶
Upgraded to the latest SDK and passing the Alation compatible version.
(AL-132242)
AZURE BLOB STORAGE OCF CONNECTOR¶
Azure Service Principal-based authentication feature is supported from Alation
version 2023.3.1. (AL-119081, AL-133846)
DENODO OCF CONNECTOR¶
Fixed selective extraction and now the connector filters tables and columns
based on the selected schema. (AL-126061)
EMR PRESTO OCF CONNECTOR¶
Fixed an issue with dynamic sampling taking user credentials from the General
Settings page. (AL-131731)
GOOGLE BIGQUERY OCF CONNECTOR¶
Fixed an issue with child statements of create procedure query not being parsed.
(AL-128150)
REDSHIFT OCF CONNECTOR¶
* We need to check the limit while accumulating/appending the string instead of
at the end of the sequence to avoid unnecessary processing. (AL-133320)
* Removed temporary instance profile option from the General Settings page.
(AL-130294)
SNOWFLAKE OCF CONNECTOR¶
* Fixed extraction queries which caused an issue when we don’t have a catalog
name in the JDBC URI and the selected Include/Exclude filter option was all
schemas except. (AL-133694)
* Snowflake has custom streamer class for filter extraction and that doesn’t
handle validation exception similar to SDK’s streamer class. As part of the
fix we added catch block to handle validation exception. (AL-134421)
STARBURST TRINO OCF CONNECTOR¶
Fixed an issue with dynamic sampling taking user credentials from general
settings page. (AL-134314)
TERADATA OCF CONNECTOR¶
* Introduced the Extract Schemas From DBASE setting, enabled by default,
allowing schema extraction from DBC.Dbase or DBC.DatabasesV based on
permissions, providing a mechanism for scenarios with limited table access.
In the absence of this support, MDE was failing if the service account did
not have permissions for DBC.Databasesv. (AL-133434)
TABLEAU OCF CONNECTOR¶
Popularity for the Workbook and Report/View objects are now supported in Alation
when using the Tableau OCF Connector.
VERTICA OCF CONNECTOR¶
Made a modification of the grammar type from ANSI to VERTICA. Previously, when
the ANSI grammar type was in use, certain SQL queries, such as SELECT * FROM
TABLE LIMIT 10;, didn’t undergo proper parsing by Alation during QLI. With this
fix, these types of queries now undergo successful parsing without encountering
any errors. (AL-129496)
BUG FIXES¶
GOVERNANCE¶
Revamped Dictionary Upload Flow: More performant and robust data dictionary
upload flow is now enabled by default on all environments. (AL-134121)
SNOWFLAKE TAG FIXES FOR POLICY CENTER¶
* Snowflake tags are removed from data dictionary during download as we do not
support persisting tag value updates via data dictionary. (AL-131699)
* For the native Snowflake connector, the tooltip text for custom fields wasn’t
getting populated correctly. This has now been fixed for OCF as well.
(AL-130336)
* In Snowflake, tags can have allowed_values set for them (see Object Tagging
in Snowflake documentation). Previously, during MDE, the values in a tag’s
allowed_values field were not populated as Custom Fields. However, when tags
were attached to objects with a value, those values got populated. Now, MDE
is fixed to get the allowed_values of Snowflake tags as Custom Fields values.
(AL-130309)
TERM & GLOSSARIES¶
* Fixed an issue causing corruption of article snapshots when articles are
edited using Bulk Utility. (AL-133010)
* Fixed an issue that resulted in a new row when copying and pasting into a
table within an article. (AL-133281)
USER MANAGEMENT¶
* Suspending users flow is optimized to clean up the active session data in a
background task. In some situations, there are 3-4M session entries that
previously caused the 504 timeouts. While the background task sweeps and
cleans up sessions, a middleware change further blocks these users and
prevents their logins for security. (AL-122130)
PATCH RELEASE 2023.3.1.2¶
build 17.1.2.54864
Released October 25, 2023
Note
This release is available for all Alation instance types: customer-managed
(on-premise) and Alation Cloud Service.
* In a recent update of Datadog Agent, a configuration change was omitted. This
resulted in email alerts being sent every 15 seconds, which led to an
excessive volume of notifications for Alation administrators. With this fix,
email alerts will be sent based on your configuration in alation_conf,
ensuring that their frequency aligns with your expectations. (AL-134151)
PATCH RELEASE 2023.3.1.1¶
build 17.1.1.54419
Released October 20, 2023
Note
This release is available for Alation Cloud Service instances on the
cloud-native architecture.
* Fixed an issue related to the Okta SCIM integration with Alation. Previously,
if a user was deleted from the Okta SCIM app and subsequently re-added, their
reactivation in Alation did not occur as expected. The issue was indicated by
the following error in the scim-debug.log file: Exception - InternalServer:
Unexpected error in updating SCIM user with id <…>. With this fix, users who
are removed and then re-added to the SCIM app in Okta will now be
automatically re-provisioned and re-activated in Alation. (AL-134886)
RELEASE 2023.3.1¶
build 17.1.0.52371
Released October 5, 2023
Note
This release is available for all Alation instance types: customer-managed
(on-premise) and Alation Cloud Service.
COMPOSE¶
GRANULAR DOWNLOAD AND EXPORT PERMISSIONS¶
Introduced user and group-level permissions for downloading and exporting query
results to ensure that only authorized users and groups can export and download
the data. Previously, Data Source Admins could enable or disable the Export and
Download feature for all users of a data source. Now, they can select individual
users and/or groups and grant them the ability to export and download. The
access settings are available:
> * On the Compose tab of the Settings page for an OCF data source
>
> * On the General Settings tab of the Settings page for a native data source
> or Custom DB.
QUERY EXPORT ALERTS¶
Added status alerts for the Export and Download feature in Compose. Compose will
show an alert if a download gets stuck or cannot be completed. You will also be
informed about the progress status (number of rows downloaded so far). This
feature can be enabled from the Compose preferences.
ABILITY TO DISABLE AUTOMATIC CONNECTIONS TO DATA SOURCES¶
Server Admins can now disable automatic connections to data sources in Compose.
With automatic connections disabled, Compose won’t use the expired credentials
to make connections automatically and cause the data source to lock up the
account.
SORT QUERY GROUPS¶
Users can now apply sorting to query groups.
MULTIPLE COMPOSE BUG FIXES¶
See Compose Bug Fixes below.
SEARCH¶
Alation now searches for matches across all text fields (picker, multi-picker,
rich text custom fields) on term tables.
GOVERNANCE¶
Data Dictionary download now includes a new first column,
al_datadict_item_properties, which contains object types and object IDs for each
object in the data dictionary. When updating an RDBMS object with a data
dictionary, this column should not be modified. When migrating curation
information from one instance to another, this column should be removed, as the
object IDs may not be correct for the target instance.
CONNECT PLATFORM¶
QUERY LOG INGESTION PIPELINE IMPROVEMENTS¶
Stabilized the performance of query log ingestion (QLI) by restricting a single
QLI job to run for seven days or less. Multiple QLI jobs can still be submitted
to account for more days as an alternative. If a QLI job is submitted for more
than seven days, an error message will be displayed in the QLI job submission UI
and referenced in the QLI job history page and the job will not run until
resolved. If any exceptions are required to loosen these restrictions and
submitting multiple QLI jobs is not an option, please request an exception via a
Support ticket.
OCF CONNECTORS¶
* Tableau OCF Connector
* Databricks on AWS OCF Connector
* Databricks on Google Cloud OCF Connector
* Databricks Unity Catalog OCF Connector
* Amazon S3 OCF Connector
* Azure Blob Storage OCF Connector
* Teradata OCF Connector
* SQL Server OCF Connector
TABLEAU OCF CONNECTOR¶
VERSION 1.6.7.6780¶
* Removed the settings Disable auto pagination, Number of workbooks to return
per request, Number of datasources returned per request, Number of
connections to return per request, and Number of fields/columns to return per
request from the connector settings page. Pagination is now always enabled.
(AL-131539, AL-129442)
* Added the ability to enable or disable the extraction of auto-generated
embedded data sources (Enable MDE for auto-generated embedded data sources).
(AL-132136, AL-125129)
* The REST API calls will now all have a timeout to prevent latency issues
leading to extremely long extraction times. (AL-129663)
* Fixed an issue with extraction where users observed duplicate and stale
objects in the catalog. Duplicates or stale objects will no longer be
created. (AL-129311)
* Fixed an issue where a failure in the popularity API request led to an error
during extraction. Added logic to correctly handle empty popularity API
responses. (AL-130126)
DATABRICKS ON AWS OCF CONNECTOR¶
VERSION 2.1.3.5925¶
Upgraded the Databricks driver in the connector to the the latest version. In
this driver version, the JDBC URI protocol was changed from spark:// to
databricks://. (AL-123135)
DATABRICKS ON GOOGLE CLOUD OCF CONNECTOR¶
VERSION 2.0.0.5925¶
Upgraded the Databricks driver in the connector to the the latest version. In
this driver version, the JDBC URI protocol was changed from spark:// to
databricks://. (AL-123141)
DATABRICKS UNITY CATALOG OCF CONNECTOR¶
VERSION 2.0.4.6984¶
Fixed an issue where a table that was previously extracted and later excluded
from extraction, was still displayed, but with the Deleted from the data source
message. Selective extraction now properly filters catalogs, schemas, tables,
and columns, and no longer contains objects from catalogs and schemas that are
not included in extraction. (AL-126886)
AMAZON S3 OCF CONNECTOR¶
VERSION 3.8.6.6821¶
Fixed an issue with extracting folders that don’t have a name, for example,
folders that are stored with a / and no explicit name. Added the ability to
extract the S3 folders with no name but having contents. Previously, we didn’t
show such folders on Alation. (AL-128411)
AZURE BLOB STORAGE OCF CONNECTOR¶
VERSION 2.4.1.7072¶
Added support for authentication with an Azure service principal (Azure Data
Lake Storage Gen 2). (AL-119081)
TERADATA OCF CONNECTOR¶
VERSION 1.0.9.6817¶
Fixed an issue with dynamic sampling and profiling where it didn’t work when the
Use LDAP Server checkbox was selected in General Settings. Dynamic sampling and
profiling now works with LDAP authentication. (AL-131715)
SQL SERVER OCF CONNECTOR¶
VERSION 1.3.5.6961¶
Fixed an issue with the Upload Data feature where it failed with the error The
uploaded data does not seem to match the selected table. Added support for the
data types nchar, nvarchar, and timestamp, which had not been available
previously. All built-in data types of SQL server that are normalized to
boolean, string, integer, float, date, time, and timestamp are now supported.
(AL-129508)
ENTERPRISE READINESS¶
ELASTICSEARCH UPGRADE¶
Upgraded the Elasticsearch component to a newer version to leverage support for
semantic search.
PYTHON UPGRADE¶
Upgraded the internal Python language libraries to a newer version to take
advantage of the new, more secure, functionality.
BUG FIXES¶
COMPOSE¶
* The parameter Always show column names in the Results section of Compose
Settings previously only applied to query runs. Now, it has been extended to
query exports. (AL-127968)
* Previously, changing the query owner of a scheduled query didn’t change the
owner of the schedule. After this fix, a change to query ownership will also
change the ownership of the schedule. (AL-130402)
* Fixed an issue where My Queries, Drafts, and By Query Group lists on the Open
Query screen did not include the unpublished queries that a user had access
to. Now, users will see all of their queries, including unpublished ones in
these query lists. (AL-124378)
* Fixed an issue where the Password field in the Connection Settings dialog was
not clear when users tried to create a second new connection. (AL-101879)
* Fixed an issue where the Format action could break the formatting for some
queries. In query variables, both keys and values are now permitted to be
case-insensitive. (AL-94131)
* Fixed an issue with the OAuth authentication for OCF Snowflake data sources
where the Connection Settings dialog showed the Authentication Successful
message when the access and refresh tokens were expired. Now, the
Authentication Failure message will be correctly displayed when token
expiration happens. (AL-100851)
* Removed the OAuth authentication status notifications that were shown in a
slide-out in the bottom right corner of the Compose user interface. OAuth
authentication status messages will be now displayed in the Connection
Settings dialog. (AL-126545)
* Fixed an issue where HTML sanitation incorrectly recognized some HTML tags
within SQL. Only script tags will now be sanitized. (AL-131716)
* Fixed an issue where query form results did not obfuscate literals while the
data source had the Obfuscate Literals setting enabled. (AL-115548)
* Fixed a bug in the Compose user interface where un-publishing and then
re-publishing a query caused the corresponding query version to appear as a
parentless version in Version History. (AL-36005)
* Fixed an issue where a query schedule could be saved without providing the
connection information. (AL-121813)
* Fixed an issue where the Conversation pull-out icon did not appear on the
query form catalog page. (AL-133248)
* Fixed an issue with the Load More button for queries on the Queries tab under
schema and table catalog objects where pressing this button did not upload
more queries into the interface. (AL-131497)
* When the service account is configured with key pair authentication for
Snowflake, the data associated with it is being used for Compose connections.
The key pair parameters should not be used for Compose connections and the
change in this ticket does an extra check to ensure this. (AL-128080)
ALATION ANALYTICS¶
* Fixed an issue where the ts_updated column was not updated when custom
templates were modified. (AL-114792)
* Fixed an issue where the current timezone of a query schedule was not
extracted into Alation Analytics. Now you’ll be able to query the timezone of
the scheduled query from the Alation Analytics data source. This can help in
estimating the exact runs of the cron jobs handling the queries. To retrieve
this information, make use of the schedule_cron_tz column in the query table.
(AL-119622)
GLOSSARIES AND ARTICLES¶
* Fixed a performance issue where the loading of linked terms on the glossary
details page took excessive time. The fix ensures much quicker responses to
hydrate both Glossary Hub and Glossary Term tables. It is controlled by the
alation_conf parameter
alation.feature_flags.enable_glossary_terms_performance that is disabled by
default and needs to be enabled if you are affected by this issue.
(AL-115695)
* Fixed an issue where the object titles mentioned in the description were
missing on the hover-over the Columns field on catalog pages of table
objects. Now, the full description will be displayed. (AL-129977)
* Previously, there was a page length control on the Term Glossary membership
dialog. It defaulted to 5, and could be adjusted to show up to 25 glossaries
per page. From Alation version 2023.1.6, this page size control was no longer
visible, but the default page size of five could not be changed. Now, fixed:
the page length can again be controlled by users in the user interface.
(AL-132113)
* Fixed an issue with Bulk Utility where domains with an ampersand (&) in the
name were not migrated. Alation now allows the domains with an ampersand to
be successfully applied to terms during migration from articles using Bulk
Utility. (AL-132214)
* Fixed an issue where the rich text editor didn’t retain formatting. Users can
now choose if they want to keep the formatting from outlook or discard it.
(AL-132418)
* Fixed an issue where suspended users were not displayed as GONE on the Access
dialog for object-level permissions–enabled objects. (AL-133111)
DATA DICTIONARY¶
* Users will now be able to upload a data dictionary file containing rich text
fields without experiencing the Unexpected Error caused by the presence of
rich text fields in the data dictionary file while generating a preview.
Additionally, we introduced the alation_conf parameter
hydrate_rich_text_field_values_on_data_dictionary_preview_ui (disabled by
default). It controls whether the existing values of rich text fields should
be hydrated by showing the corresponding display text for each of the
mentions on the preview screen. (AL-129392)
OTHER BUG FIXES¶
* Addressed an issue where the Subdomains field was not available for addition
to the domain template after it was deleted. Alation now prevents users from
removing of the Subdomains and Domain Users components from the domain
template. (AL-127364)
* Made a performance enhancement to speed up retrieval of object sets. You can
still return to the previous way of retrieving object sets by disabling the
alation_conf flag DEV_enable_object_set_value_visible_v2 (enabled by
default). (AL-112701)
* Fixed an issue where file system object count reporting query used up lot of
disk space. Optimized the query to avoid excessive disk usage. (AL-132803)
* Fixed a behavior where LMS history files were deleted when any error happened
during processing. (AL-132602)
RELEASE 2023.3.0 - GENERAL AVAILABILITY¶
build 17.0.0.49181
Released September 5, 2023
ALATION AGENT¶
ALATION AGENT NOTIFICATIONS¶
Once a user subscribes to Alation Agent notifications, the user will receive
email alerts 60, 45, 30, 20, 10, 5 and 1 day before the certificate expires. If
the certificate expires due inaction, daily reminders will be sent to ensure
action is taken.
ALATION AGENT DIAGNOSTIC TOOL¶
The Agent diagnostic tool allows users to troubleshoot connectivity issues
between the Alation Agent and Alation. It runs a series of diagnostic steps, and
is installed on the Agent node. The tool provides an easy way to gather all the
connector logs with a simple command.
ALATION AGENT DOCKER VERSION UPDATE¶
Upgraded the version of Docker bundled with the alation_container_service to
24.0.5.
ALATION ANALYTICS¶
STEWARDSHIP DATA IS AVAILABLE IN ALATION ANALYTICS¶
Stewardship Workbench (Bulk Actions) data is now available in Alation Analytics.
With this change, customers can query Alation Analytics to get metrics around
bulk actions.
THIRD-PARTY BI ACCESS TO ALATION ANALYTICS¶
Cloud-native architecture only
Alation Cloud Service customers on the cloud-native architecture can now connect
third-party BI tools to Alation Analytics. This is done by replicating your
Alation Analytics database to Snowflake, where you can connect your BI tools to
access Alation Analytics data.
ALATION ANYWHERE¶
SLACK CONVERSATIONS¶
Added support for previewing Conversation object types in Slack, and added the
conversation option for all supported object types. A user is able to quickly
start new conversation from Slack per specific object, reply to conversation, or
mark one as resolved.
PREVIEW DASHBOARD OBJECT TYPES IN SLACK AND MICROSOFT TEAMS¶
Support of enhanced Dashboard preview in Alation Anywhere for Slack and
Microsoft Teams integration.
ALATION DATABASE SCHEMA ENHANCEMENTS¶
Modified the Alation database schema to support larger volumes of metadata.
Users can now ingest more metadata on a frequent basis without running into
issues with integer overflow. Note that migrations during an upgrade can add an
additional 30 minutes depending on the volume of the metadata.
COMPOSE¶
FLEXIBLE QUERY RESULT PROTECTION¶
To ensure Alation instances comply with customer security policies, this feature
provides more control and flexibility to datasource admins on how query results
can be shared. Datasource admins have three levels of control on whether the
sharing the query result is allowed or not: No sharing is permitted, only
private sharing is allowed, or allowing private and public sharing. Datasource
admins can also control if users have the ability to preserve query results
without automatic deletion
COMPOSE COMPATIBILITY WITH QUERY SERVICE-ENABLED OCF CONNECTORS¶
Compose is now compatible with Query Service enabled Starburst Trino and
SybaseIQ OCF Connectors, so that clients using these data sources can migrate to
these OCF Connectors.
COMPOSE EXPORT NOTIFICATIONS¶
When Exporting a query execution, Compose will show an alert message containing
the title of the query and the number of result rows exported upon each
completed query statement, so that users are informed if the Export is
successful.
CONNECTED SHEETS IMPROVEMENTS¶
* Users can now see Column Titles were available in search left navigation bar
* Search results auto expand in left navigation
CONVERSATIONS¶
CONVERSATIONS ARE NOW REFLECTED IN DOMAINS¶
Conversations about catalog objects, which are associated with data domains, are
now transitively associated to the same domains.
MULTIPLE USERS AND GROUPS ASSIGNED TO CONVERSATIONS¶
* Handling multiple assignees for a single conversation (before the change only
one user could be assigned to a conversation).
* Added possibility to assign group profiles to conversations.
AUTHENTICATION¶
METADATA EXTRACTION BASED ON CROSS-ACCOUNT IAM ROLE-BASED AUTHENTICATION¶
Support for cross-account authentication is needed for Metadata Extraction (MDE)
between the Alation instance and AWS resources that might reside in different
AWS accounts. With IAM role-based authentication, customers do not have to enter
IAM user credentials in the Alation Catalog. Authentication is performed based
on trust set up between an IAM role in the Alation account and an IAM role set
up in the customer’s AWS account where the AWS resource is running. Metadata
extraction and query log ingestion from the following OCF AWS connectors: S3,
Glue, Athena, and Redshift, are supported by this feature.
API AUTHENTICATION USING JWT - CLOUD-NATIVE ARCHITECTURE ONLY¶
APIs can now be secured with JWT token-based authentication in addition to using
opaque tokens. With this new authentication, customers can register an external
application with Alation and use the JWT tokens assigned to the application for
authentication and authorization.
CLOUD CONFIGURATION - CLOUD-NATIVE ARCHITECTURE ONLY¶
NEW CLOUD-NATIVE ARCHITECTURE SERVICE: ENTITLEMENT AND LICENSE MANAGEMENT
SERVICE¶
Cloud Entitlement and License service displays customer licenses in the license
user interface page based on entitlement grants/revocations and track usage of
features. The license screen can be viewed only by Server Admins.
CONNECTORS¶
AZURE BLOB STORAGE OCF CONNECTOR, VERSION 2.3.4¶
Improved the Azure Blob Storage OCF Connector performance by streaming
directories on the fly instead of storing it in memory.
AZURE DATABRICKS OCF CONNECTOR¶
Azure Databricks OCF Connector Driver has been upgraded to 2.6.33. (AL-97592)
DATABRICKS UNITY CATALOG OCF CONNECTOR, VERSION 2.0.3¶
* Added QLI support and upgraded the Simba Spark Driver 2.6.21 to the
Databricks JDBC driver 2.6.33. (AL-118979)
* Disabled QLI Lineage by default. The datasource admins no longer need to
disable the automatic lineage generation flag on the datasource settings page
manually to turn off QLI Lineage. (AL-130658)
GOOGLE BIGQUERY OCF CONNECTOR, VERSION 1.1.8¶
Improved the memory management and performance of the Google BigQuery OCF
Connector. (AL-125140)
POWER BI OCF CONNECTOR¶
Power BI Dataflow features introduced for Power BI Scanner Connector.
(AL-111227)
* PowerBI Dataflow objects are now cataloged within Alation for the PowerBI OCF
Scanner Connector.
* Dataflow objects provide reusable transformation logic that can be shared by
Datasets and Reports within PowerBI and the Power Platform.
* Dataflow objects strengthen security around underlying datasources by
exposing required data within it for reports instead of from the datasource.
* Dataflows are cataloged alongside Datasets in Alation.
* Users can now view the datasource referred by the Dataflow along with
Datasets and Reports that are created from it and the fields that comprise
the dataflow object.
* Hybrid sources that power a Dataset, for example, created from Dataflow(s)
and another datasource are now visible.
* Dataflow objects can be nested i.e. created from other Dataflows.
SNOWFLAKE OCF CONNECTOR¶
* Added check for supported Alation versions during installation. (AL-129242)
* Installation will fail on unsupported Alation versions. (AL-129242)
SQL OCF CONNECTOR¶
* Added check for supported Alation versions during installation. (AL-129243)
* Installation will fail on unsupported Alation versions. (AL-129243)
STARBURST TRINO OCF CONNECTOR, VERSION 1.2.8¶
* Fixed the issue when a customer adds catalog name in JDBC URI, GET list of
schemas picks up schemas for all catalogs. (AL-127362)
* Changed Parser Grammar type from ANSI to PRESTO to align with native
connector implementation. (AL-127352)
TABLEAU OCF CONNECTOR, VERSION 1.6.1¶
* Resolved out of memory issues and added support for report fields value
sampling. (AL-127096) (AL-120383)
* Fixed report columns value sampling feature. (AL-114383)
* Added owner property for projects and sub projects. (AL-127028)
* Added lineage support for tableau dashboards with hidden sheets. (AL-125127)
ENHANCED USER EXPERIENCE FOR THE OCF CONNECTOR AUTHENTICATION PROCESS (PRIVATE
PREVIEW)¶
OCF Connector Authentication improvements include: (AL-125067)
* Enlarged the URI field to improve user readability and editing.
* Clear help text for URI and QLI fields.
* Streamlined the interface to display relevant fields based on the selected
authentication method.
* Rearranged the authentication process to follow a logical order: Connection,
Service Account, Permissions, and QLI.
GOVERNANCE – MACHINE LEARNING¶
ALLIE STEWARD SUGGESTIONS (PUBLIC PREVIEW – CLOUD-NATIVE ARCHITECTURE ONLY)¶
Allie Suggested Stewards helps users automatically find the right people as
stewards for each data object. This feature leverages a machine learning model
that suggests stewards based on interactions, and also improves the suggestions
over time by learning from user actions. This is applicable for cloud-native
architecture customers only.
LINEAGE¶
COMPOUND LAYOUT FEATURE IMPROVEMENTS (E2E COLUMN-LEVEL TRACING/BETA LAUNCH)¶
The compound layout feature, which has been available behind feature flags since
2022.4, is now available as a Beta offering to all customers in all
environments. The compound layout feature groups data sources, e.g. Snowflake,
separately from other data sources, e.g. Tableau, to provide focus on data
movement for certain objects, e.g. tables, across these data sources. This
feature has been enhanced to drill down from data sources to the column level
with the ability to trace columns upstream and downstream across data source
groups to capture a holistic E2E lineage view. (AL-126630)
SUPPORT FOR RENAME AND DELETION OF RDBMS DATA SOURCES IN LINEAGE SOURCE GROUPS¶
* Deleting an RDBMS datasource deletes the corresponding lineage source group.
* Renaming a RDBMS source renames the corresponding lineage source group.
IMPOVED LINEAGE PERFORMANCE¶
Created scripts to clean up duplicate temp objects and dataflows from lineage to
address performance issues with large graphs. (AL-107764)
NATIVE TO OCF MIGRATION¶
Improvements made related to Bulk API for Native to OCF Migration. (AL-12868)
POSTGRESQL UPGRADE¶
PostgreSQL is upgraded to 13.11 from 13.6.
SEARCH¶
SAVE COLUMN SELECTIONS IN SAVED SEARCH¶
Saved Search will automatically save the column selections and their sequence in
the Search Results Table view, so that users will see their prior column
selections when they retrieve their Saved Searches.
TERMS AND GLOSSARIES IMPROVEMENTS¶
* Customers will now see all valid custom fields, fields present on one or more
term type templates, as selectable options on Term Tables by default.
(AL-127525).
* Verbiage on Bulk Utility article body has been updated to indicate that other
usages are “not supported” (previously “not recommended”). (AL-127569).
* Term detail pages now show the “Description” field name. (AL-128745).
APIS¶
PUBLIC APIS FOR TABLE USER PERMISSION / PRIVACY UPDATES¶
Added Public APIs for updating the table permissions and privacy settings. More
information is available in the swagger docs under
‘/openapi/members_permission/’ and ‘/openapi/privacy_settings/’. Server admins
by default have access to both APIs. Members with catalog or source admin roles
can only access these APIs if they are tagged as data source admins for the
table’s parent data source.
UPLOAD DATA DICTIONARY PUBLIC API (PUBLIC PREVIEW)¶
Public Preview of Upload Dictionary Public API that brings an improved,
performant and asynchronous approach to update records supporting a csv as an
input file.
CONVERSATION PUBLIC API VERSION 2¶
The new API is available at the following endpoint:
‘/integration/v2/conversations/’. This API includes the ability to handle
multiple assignees for a single conversation and added the possibility to assign
group profiles to conversations.
CONVERSATIONS PUBLIC API IMPROVEMENTS¶
* Conversations Public API is updated with advanced handling of deleted
conversations, including new search options and possibility to restore
deleted conversation.
* Updated the Conversations Public API V2 and Conversations Internal API to
support new searching and filtering options. Users can search for
conversations by creation date, assignee, or last response date. (AL-125306).
WORKFLOWS PUBLIC APIS¶
Public APIs for workflows are now available. These will allow users to list all
the workflow requests, create a change request, and show workflow request
details.
BUG FIXES¶
* Alation Analytics: - Fixed issue causing customer to not be able to query
rdbms_columns. (AL-126878)
* Fixed issue causing deprecation flag description that was updated using the
API not being updated in Alation Analytics V2. (AL-123876)
* BI Migration:
* Migration script validates if source and target are the same before
starting migration using the script. (AL-127623)
* Added validation for source and target when migrating servers from native
to OCF in Alation. (AL-126483)
* Bulk Import Utility: Fixed an issue causing keys inconsistency and
incomplete, missing data source ID (ds_id) and causing an error. Download
template now has all object sets of type table, data source, column, schema
prepended with ds_id. (AL-119516)
* Bulk Utility: Fixed issue to avoid Bulk Utility Download process issue on
encountering a Term linked to a Glossary without title. (AL-125179)
* Compose:
* Comment syntax inside query variables are now treated as plain text.
(AL-128065)
* The “Open New Query In Compose” button from AAV2 dashboards now creates
queries without titles and prevents them from being automatically published
to avoid duplicate queries. (AL-126656)
* Fixed issue causing Schedule Result Sharing Modal to not follow the admin
setting ‘Allow Public Sharing Of Compose Results’. After the fix, public
sharing is disabled if it is disabled from admin settings. (AL-124132)
* Conversations: Fixed an issue causing the conversation resolution status to
be empty or null. (AL-106466)
* Google BigQuery OCF Connector: Fixed issue causing Lineage to not display for
Temporary Tables and other connected upstream and downstream tables, although
the queries are parsed successfully. Added support to show the lineage via a
temporary node. (AL-117243)
* Governance/Workflow: Fixed issues for Review Policy/Term object set and
Suggest column object set. (AL-128809)
* Lineage:
* Added support to create lineage for duplicate queries with different
comments across data sources. (AL-125865)
* Fixed issue causing incorrect list of data sources to display for DataFlow
sources. Deleting or renaming a RDBMS source now deletes/renames its
corresponding lineage source groups. (AL-120403)
* Fixed issue to support column-level lineage (CLL) for Select * queries with
SET operators. (AL-77284)
* Power BI Scanner OCF Connector: Fixed connector links for apps and app
related objects. (AL-120876)
* RDBMS Migration: Migration script validates if source and target are the same
before starting migration using the script. (AL-127532)
* Search:
* Fixed an issue causing multi-picker custom fields in catalog search to not
display an accurate not_set count for custom fields. (AL-116323) (AL-95802)
* Fixed an issue when using Edit Columns on the Advanced Search page to not
display custom fields. (AL-100937)
* Fixed appearance of backend value for “not set” filter. (AL-130483)
* Snowflake OCF Connector:
* Fixes KeyError that occurs while Snowflake tag ingestion when a
schema/table/column associated with a Snowflake tag is not found in
Alation. (AL-128018)
* Fixed failure in policy links ingestion due to missing objects caused by
inconsistent custom queries for tables and columns. (AL-125463)
* Fix failure in tag links ingestion due to missing objects caused by
inconsistent custom queries for schemas, tables and columns. (AL-125462)
* Fixed issue causing the error when trying to establish database connection
in Compose when Snowflake datasource is configured to use OAuth.
(AL-124305)
* Fixed issue when detecting role switching for Snowflake configured using
External Authentication. (AL-122112)
* Lineage is not getting created for Snowflake Create View DDL queries having
“With Tag” clause. (AL-115186)
* Tableau OCF connector: Fixed connector links in Tableau OCF connector.
(AL-118648)
KNOWN ISSUES¶
* The upgrade to 2023.3.1 or a later minor version of 2023.3 may fail due to
Postgres failing to start. The issue affects some of the Alation Cloud
Service instances that have not been migrated to the cloud-native
architecture and the on-premise instances that used a custom approach to the
installation and installed the Postgres component in a Docker container. This
issue can be addressed through a workaround: 2023.3.x Upgrade Fails Due to
Postgres Not Starting. A fix will be provided in a future Alation version.
Previous
Release Notes 2024.1 (General Availability)
Next
Release Notes 2023.1 (General Availability)
Request docs changes Download PDF
On this page
* Release Notes 2023.3 (General Availability)
* RELEASE 2023.3.5.2
* RELEASE 2023.3.5.1
* RELEASE 2023.3.5
* The Connect Platform
* Catalog Visibility Management for BI Sources
* AWS PrivateLink Support for Amazon S3 OCF Sources
* Alation Agent Polling Mode
* Alation Public APIs
* Access to the Custom Field Value API for Catalog Admins
* Ability to Manage BI Source Visibility via API
* New API to Manage Data Source Connections for a BI Server Source
* Terms API Can Filter by Glossary and Provides More Info
* Fixes to Data Dictionary API and Articles API
* Search
* Filtering by Catalogs
* Navigation
* Control Users’ Ability to Select Preferred Homepages
* User Management
* User Sign-Up Moderation Enabled by Default
* SCIM Integration Enhancements
* Renaming of Glossary Terms Feature Flags
* OCF Connectors
* New Connector Releases
* Connector Settings User Experience Redesign
* Other Updates
* Cross-Data-Source Lineage for MicroStrategy BI Sources
* OCF Tableau Enhancements
* OCF Oracle E-Business Suite 12.2.12 Certification
* Alation Agent Certification with Compose for More Connectors
* Bug Fixes
* Data Dictionary
* Alation Analytics
* Governance
* Other Fixes
* PATCH RELEASE 2023.3.4.1
* RELEASE 2023.3.4
* Alation Anywhere
* Alation Anywhere for Microsoft Teams (Cloud Native Architecture only)
* Alation Analytics
* Alation Analytics Dashboard Improvements
* Enable Third-Party Metrics in Alation
* Alation Analytics Backup and Restore Improvements
* Improvements to Alation Analytics for BI Access
* Compose Improvements
* Cloud Authorization
* SCIM Token Generation Warning
* Data Dictionary Improvements
* Glossary and Articles
* Governance Improvements
* Group-based Homepages
* Search Enhancements
* APIs
* OCF Data Sources API Compose Support
* Bug Fixes
* Cloud Authorization: Bypass User Email Confirmation for SSO-based
Authentication Flows
* Glossary and Articles
* KVstore Improvements
* PATCH RELEASE 2023.3.3.2
* PATCH RELEASE 2023.3.3.1
* RELEASE 2023.3.3
* Compose
* Past Scheduled Executions Dashboard for Admins
* Improved Query Export Scalability
* Data Dictionary Improvements
* Alation Analytics
* Glossary Improvements
* Absolute User Session Timeout (Cloud-Native Architecture only)
* Alation API
* Custom Field Value APIs
* Public API for SCIM Token Generation
* Cloud Infrastructure
* Bug Fixes
* PATCH RELEASE 2023.3.2.2
* PATCH RELEASE 2023.3.2.1
* RELEASE 2023.3.2
* Alation Analytics
* Basic Authentication for RabbitMQ
* Object and User Counts
* Improvements for Third-Party BI Access via Snowflake
* Snowflake Password Requirements Enforced
* Clear Analytics Data - Fixed
* Alation Anywhere
* Authentication
* Compose Enhancements
* Connected Sheets OAuth Enhancements
* Governance
* Install and Upgrade
* Lineage
* Asset Grouping Icons for Datasource Cluster Nodes
* Search
* Synonym Search On Cloud-Native Architecture
* New Public API for the Management of Synonyms
* User Management: Generate SCIM Tokens in the User Interface
* Connect Platform
* Zero Touch Agent - Downloadable Installers through Public API
* OCF Connectors
* HDFS OCF Connector—New!
* MicroStrategy OCF Connector—New!
* Salesforce OCF Connector—Limited Availability
* Bug Fixes for Multiple OCF Connectors
* Athena OCF Connector
* AWS Glue OCF Connector
* Azure Blob Storage OCF Connector
* Denodo OCF Connector
* EMR Presto OCF Connector
* Google BigQuery OCF Connector
* Redshift OCF Connector
* Snowflake OCF Connector
* Starburst Trino OCF Connector
* Teradata OCF Connector
* Tableau OCF Connector
* Vertica OCF Connector
* Bug Fixes
* Governance
* Snowflake Tag Fixes for Policy Center
* Term & Glossaries
* User Management
* PATCH RELEASE 2023.3.1.2
* PATCH RELEASE 2023.3.1.1
* RELEASE 2023.3.1
* Compose
* Granular Download and Export Permissions
* Query Export Alerts
* Ability to Disable Automatic Connections to Data Sources
* Sort Query Groups
* Multiple Compose Bug Fixes
* Search
* Governance
* Connect Platform
* Query Log Ingestion Pipeline Improvements
* OCF Connectors
* Tableau OCF Connector
* Version 1.6.7.6780
* Databricks on AWS OCF Connector
* Version 2.1.3.5925
* Databricks on Google Cloud OCF Connector
* Version 2.0.0.5925
* Databricks Unity Catalog OCF Connector
* Version 2.0.4.6984
* Amazon S3 OCF Connector
* Version 3.8.6.6821
* Azure Blob Storage OCF Connector
* Version 2.4.1.7072
* Teradata OCF Connector
* Version 1.0.9.6817
* SQL Server OCF Connector
* Version 1.3.5.6961
* Enterprise Readiness
* Elasticsearch Upgrade
* Python Upgrade
* Bug Fixes
* Compose
* Alation Analytics
* Glossaries and Articles
* Data Dictionary
* Other Bug Fixes
* RELEASE 2023.3.0 - General Availability
* Alation Agent
* Alation Agent Notifications
* Alation Agent Diagnostic Tool
* Alation Agent Docker Version Update
* Alation Analytics
* Stewardship Data Is Available in Alation Analytics
* Third-Party BI Access to Alation Analytics
* Alation Anywhere
* Slack Conversations
* Preview Dashboard Object Types in Slack and Microsoft Teams
* Alation Database Schema Enhancements
* Compose
* Flexible Query Result Protection
* Compose Compatibility with Query Service-enabled OCF Connectors
* Compose Export Notifications
* Connected Sheets Improvements
* Conversations
* Conversations are now Reflected in Domains
* Multiple Users and Groups Assigned to Conversations
* Authentication
* Metadata Extraction based on Cross-Account IAM Role-based
Authentication
* API Authentication using JWT - Cloud-native architecture only
* Cloud Configuration - Cloud-native architecture only
* New Cloud-Native Architecture Service: Entitlement and License
Management Service
* Connectors
* Azure Blob Storage OCF Connector, version 2.3.4
* Azure Databricks OCF Connector
* Databricks Unity Catalog OCF Connector, version 2.0.3
* Google BigQuery OCF Connector, version 1.1.8
* Power BI OCF Connector
* Snowflake OCF Connector
* SQL OCF Connector
* Starburst Trino OCF Connector, version 1.2.8
* Tableau OCF Connector, version 1.6.1
* Enhanced User Experience for the OCF Connector Authentication Process
(Private Preview)
* Governance – Machine Learning
* Allie Steward Suggestions (Public Preview – Cloud-native architecture
only)
* Lineage
* Compound Layout Feature Improvements (E2E Column-Level Tracing/Beta
Launch)
* Support for Rename and Deletion of RDBMS data sources in Lineage Source
Groups
* Impoved Lineage Performance
* Native to OCF Migration
* PostgreSQL Upgrade
* Search
* Save Column Selections in Saved Search
* Terms and Glossaries Improvements
* APIs
* Public APIs for Table User Permission / Privacy Updates
* Upload Data Dictionary Public API (Public Preview)
* Conversation Public API Version 2
* Conversations Public API Improvements
* Workflows Public APIs
* Bug Fixes
* KNOWN ISSUES
Close
ALATION DOCUMENTATION PDF
This PDF contains all our documentation and is more than 120 MB in size. We
recommend using an ethernet or Wi-Fi connection for downloading.
Download PDF Cancel
Search by Read the Docs & readthedocs-sphinx-search
v: latest
Versions latest On GitHub View Edit
--------------------------------------------------------------------------------
Documentation hosted by Read the Docs