feat(GAT-000): Align CRUK dummy dataset fixtures with GWDM 2.1 schema#1
Closed
cocoon02 wants to merge 105 commits into
Closed
feat(GAT-000): Align CRUK dummy dataset fixtures with GWDM 2.1 schema#1cocoon02 wants to merge 105 commits into
cocoon02 wants to merge 105 commits into
Conversation
## [2.37.0](HDRUK/gateway-api@v2.36.0...v2.37.0) (2026-03-19) ### ✨ Features * **GAT-0000:** Optimising auth login from ~3s to < 1s (HDRUK#1558) ([be36fa8](HDRUK@be36fa8)), closes [GAT-0000](GAT-0000) * **GAT-0000:** Refactoring to enable partner context for API operation for CRUK and others, and optimisations when noticed (HDRUK#1569) ([6d6120b](HDRUK@6d6120b)), closes [GAT-0000](GAT-0000) * **GAT-5218:** publications has keywords (HDRUK#1575) ([951c7aa](HDRUK@951c7aa)), closes [GAT-5218](GAT-5218) * **GAT-5397:** Include linkage type for publication card (HDRUK#1574) ([f9be66a](HDRUK@f9be66a)), closes [GAT-5397](GAT-5397) * **GAT-6015:** publication date (HDRUK#1543) ([f4f7e69](HDRUK@f4f7e69)), closes [GAT-6015](GAT-6015) * **GAT-7340:** Add data custodian network information to Datasets (HDRUK#1566) ([aba7bdb](HDRUK@aba7bdb)), closes [GAT-7340](GAT-7340) * **GAT-7376:** Create ability to run now for Predefined Integration (HDRUK#1582) ([c1175e8](HDRUK@c1175e8)), closes [GAT-7376](GAT-7376) * **GAT-7580:** Update endpoints to enable addition of Data Custodian name (HDRUK#1568) ([3ccd2c0](HDRUK@3ccd2c0)), closes [GAT-7580](GAT-7580) * **GAT-7768:** filter OOO emails (HDRUK#1560) ([3c610e6](HDRUK@3c610e6)), closes [GAT-7768](GAT-7768) * **GAT-7957:** added Github app authentication (HDRUK#1561) ([eac54b5](HDRUK@eac54b5)), closes [GAT-7957](GAT-7957) * **GAT-8092:** Update endpoint for Dataset & BioSample landing pages to include summary.datasetAliases (HDRUK#1570) ([3d1e64d](HDRUK@3d1e64d)), closes [GAT-8092](GAT-8092) [BioSample](oSample) * **GAT-8123:** homepage statistics (HDRUK#1538) ([0742bdc](HDRUK@0742bdc)), closes [GAT-8123](GAT-8123) * **GAT-8233:** DAR answer add new field (HDRUK#1553) ([f2061a5](HDRUK@f2061a5)), closes [GAT-8233](GAT-8233) * **GAT-8242:** Add action bar to DAR (HDRUK#1539) ([3b2166e](HDRUK@3b2166e)), closes [GAT-8242](GAT-8242) * **GAT-8242:** Fix OA comments (HDRUK#1546) ([6ce346a](HDRUK@6ce346a)) * **GAT-8246:** Data Custodian Networks now return team_ids to help with filters (HDRUK#1565) ([d38535b](HDRUK@d38535b)), closes [GAT-8246](GAT-8246) * **GAT-8329:** Extend Gateway Metadata Integration (HDRUK#1583) ([2b9fad8](HDRUK@2b9fad8)), closes [GAT-8329](GAT-8329) [Gateway](Gateway) * **GAT-8384:** added release pipeline (HDRUK#1547) ([20e328b](HDRUK@20e328b)), closes [GAT-8384](GAT-8384) * **GAT-8384:** fixed lint errors (HDRUK#1549) ([d857f61](HDRUK@d857f61)) * **GAT-8384:** fixed the PR title file (HDRUK#1552) ([cc03927](HDRUK@cc03927)) * **GAT-8450:** Update existing and add any new emails required (HDRUK#1571) ([1781b42](HDRUK@1781b42)), closes [GAT-8450](GAT-8450) * **GAT-8465:** rework of widget colours (HDRUK#1584) ([db490d8](HDRUK@db490d8)), closes [GAT-8465](GAT-8465) * **GAT-8534:** update export metadata (HDRUK#1540) ([32bae25](HDRUK@32bae25)), closes [GAT-8534](GAT-8534) * **GAT-8586:** admin update cohort discovery state in datasets (HDRUK#1562) ([abee8da](HDRUK@abee8da)), closes [GAT-8586](GAT-8586) * **GAT-8610:** Fix access checks for scrambled open-athens emails (HDRUK#1567) ([1c58b9a](HDRUK@1c58b9a)) * **GAT-8635:** Update search service to include keywords for Publications (HDRUK#1576) ([a82d2a7](HDRUK@a82d2a7)), closes [GAT-8635](GAT-8635) ### 🐛 Bug Fixes * **GAT-0000:** export metadata Distribution release date (HDRUK#1544) ([76410ed](HDRUK@76410ed)), closes [GAT-0000](GAT-0000) * **GAT-0000:** fix for the collection observer (HDRUK#1579) ([a3e6bbe](HDRUK@a3e6bbe)) * **GAT-0000:** fix send email cohort request) (HDRUK#1573) ([5853068](HDRUK@5853068)) * **GAT-0000:** Fix user on auth being returned as array instead of ob… (HDRUK#1559) ([72df3d4](HDRUK@72df3d4)) * **GAT-7418:** TVS SDE datasets all have the same PID in the database (HDRUK#1563) ([a07783a](HDRUK@a07783a)), closes [GAT-7418](GAT-7418) * **GAT-7951:** Applicant organisation details are not being pulled through to enquiry template (HDRUK#1557) ([87c0e74](HDRUK@87c0e74)), closes [GAT-7951](GAT-7951) * **GAT-8106:** Reduce page load time search collections networks (HDRUK#1555) ([84c5cab](HDRUK@84c5cab)), closes [GAT-8106](GAT-8106) * **GAT-8119:** update notifications (HDRUK#1548) ([ec1456e](HDRUK@ec1456e)), closes [GAT-8119](GAT-8119) * **GAT-8530:** Structural Metadata download (HDRUK#1572) ([86c0450](HDRUK@86c0450)), closes [GAT-8530](GAT-8530) * **GAT-8579:** NHS SDE approval is wrong (HDRUK#1556) ([ca5e345](HDRUK@ca5e345)), closes [GAT-8579](GAT-8579) * **GAT-8640:** swagger update tags (HDRUK#1577) ([0361eda](HDRUK@0361eda)), closes [GAT-8640](GAT-8640) * **GAT-8664:** loading Data uses (HDRUK#1581) ([ff14f83](HDRUK@ff14f83)), closes [GAT-8664](GAT-8664) * **GAT-9999:** Fixes (DP-492) issues surrounding auth sometimes failing (HDRUK#1542) ([8cc7cbc](HDRUK@8cc7cbc))
… third-party websites (HDRUK#1654)
…f provider to search (HDRUK#1663)
Replace generic random dataset versions with one-to-one CRUK metadata seeding so local dev matches partner_context isolation and project grant demo data.
Keep DatasetSeeder and DatasetVersionSeeder unchanged for default HDRUK seeding; add CRUKDatasetSeeder and CRUKDatasetVersionSeeder for optional CRUK fixture data.
Enables partner frontends to send the partner context header on cross-origin API requests.
Apply partner_context to v1 search results, index CRUK seeds as ACTIVE in Elasticsearch, and accept array keywords when reindexing.
Bring in latest dev changes before PR merge.
Restructure dataset_01–19 to match dataset_00 metadata shape so seeding and indexing use consistent summary, accessibility, and linkage fields.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
9 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds CRUK partner-context dataset seeding using 20 GWDM 2.1 fixture files, and aligns dataset_01–dataset_19 with the dataset_00 metadata schema so seeding, indexing, and project-grant extraction all use a consistent structure.
Normalises fixture metadata to the GWDM 2.1 shape (summary, coverage, provenance, accessibility, linkage, projectGrants, etc.)
Populates summary fields (leadResearcher, leadResearchInstitute, publisher, description) from project grant and custodian data in each fixture