Dashboards - Data Issues
To do on Dashboards - errors that may be reported by users - 13 May 2024
Scoped only to ARC dataset
No workarounds possible
167 grants have no Administering Organisation - no workaround possible. List of grants with missing admins is available
41 grants have no start date - mostly new grants - no workaround possible. List of grants with missing start date is available
Check geo locations on grants. Some have geo locations for former Administering organisation and not the current Admin organisation. These show on the Map - no workaround possible
Update 18 May (JD) i think this is the behavior. If the following is confirmed then I can address with documentation
Partner organisations listed on a grant have a location assigned using ABN data. Not all organisations have been matched to an ABN, or they might not have an ABN. Current and former partners are included.
Additional issues 15 May 2024
Timeouts
The Uni list is timing out in the Dashboards. It’s visible to users as an on-screen alert. This is due to a Runtime field of 42 if-then loops through organisations to identify Australian universities. The Runtime field is “AusUni”. This is the highest priority for converting a Runtime field to run at index time. More info see Runtime Fields
Workarounds possible
254 Grants are missing Primary FOR codes ie summary.primaryVocabs.label.keyword - there is a Runtime Field workaround in place - see Runtime Fields
237 have no primary.subject - there is a Runtime Field workaround in place see Runtime Fields
If index is not reduced to ARC-only, then the start date will show the earliest date in the index - ie before the first ARC grant (2000) - workaround in place. Done, workaround removed
Jo D to do:Provide mapping names so that filters make sense in Dashboards - Done
Reported as a ticket 19 August
1
Data issues impacting RLA Dashboards - For the Dev team - Administering organisation
Data errors/issues impacting RLA Dashboards
Scoped to ARC dataset in ElasticSearch
As at May 2024
167 grants have no Administering Organisation - no workaround possible.
An action was previously applied to ARC data so that most grants have this data element, please now run it again
Here is a list of grants with missing Administering Organisation
https://docs.google.com/spreadsheets/u/0/d/1tuF-gisQJ894jGwEmgKDIizD9urkc7f0XS-vL6Q9ikA/edit
2
Data issues impacting RLA Dashboards - For the Dev team - Missing Start Date
Data errors/issues impacting RLA Dashboards
Scoped to ARC dataset in ElasticSearch
As at May 2024
41 grants have no Start Date - no workaround possible.
An action was previously applied to ARC data so that most grants have this data element, please now run it again
Here is a list of grants with missing Start Date
https://docs.google.com/spreadsheets/d/141iTFOgX0HmUQnLra6u-kY4KtiHZJuhtYRNDibajh6w/edit?usp=sharing
3
Data issues impacting RLA Dashboards - For the Dev team - Memory Intensive Runtime Field causes timeouts
Data errors/issues impacting RLA Dashboards
Scoped to ARC dataset in ElasticSearch
Memory Intensive Runtime Field causes timeouts
The Uni list is timing out in the Dashboards. It’s visible to users as an on-screen alert. This is due to a Runtime field of 42 if-then loops through organisations to identify Australian universities. The Runtime field is “AusUni” and the code is available in Kibana
The script required is similar to the script already running that selects individual Nonpublic organisations. In fact if the script to identify nonUniversityPartner had an “else” section, everything that is not a nonUniversityPartner is an Australian University
This is the highest priority for converting a Runtime field to run at index time. More info see https://docs.google.com/document/u/0/d/1sKY658ZaPyMFPocnmQS2_67auhOXJMtXzJtQC2UKbLk/edit