2024-11-22 Hyrax Fedora 6 Working Group

 Date

Nov 22, 2024@9am Eastern

 Participants

  • @Arran Griffith

  • @Ben Pennell

    @Bradley Watson

  • @Collin Brittle

  • @Dan Field

  • @Daniel Pierce

  • @Emily Porter

  • @Heather Greer Klein

  • @Jon Dunn

  • @Juliet Hardesty

  • @Kate Dohe

  • @Nicholas Mark Homenda

  • @Scott Prater image-20241119-194743.png

  • @Randall Floyd

  • @Rebekah Kati

  • @Tom Wrobel

indicates note taker

Goals

  • Updates on progress for ongoing development work

 Discussion topics

Item

Item

Welcome

Updates:

What work remains?

Wrap Up

Next meeting:

  • Scheduled for Dec 27th - proposal of a new meeting? Or wait until Jan?

Next note taker: Randall Floyd

Notes

 Action items

  •  Check on if more work needs to be done to cover all the predicates from hyrax so that they get persisted to Fedora with a real URI, particularly FITS ones.

Discussed Items:

Nick Homenda is the new Hyrax PO - unable to attend this meeting

  • Rebekah Kati will continue to attend because of UNC’s interest.

Fedora 6.5.1 RC still available for testing - has anyone had a chance from this group to look?

slash in path;

  • Hyrax/Valkyrie has workarounds for it, but would be nice to not to

need it; it would be good to include fix in next RC

  • Dan Field will get updated RC in Docker Hub

  • Daniel Pierce: Sirenia spec tests all passing, except for custom SQL

queries; working on organizing tests

Performance Testing

  • Julie Hardesty: is goal to get this work included in Nurax, then run

performance tests?

  • Daniel Pierce: Yes

    • Emily Porter: Emory can also do some anecdotal performance testing;

maybe some comparison testing with pg-nurax

Nurax Challenges: getting enough data in repo for good performance testing

  • Brad Watson: may be able to help generate content (100,000 small

files) -- scripted backend

Emory noted issues with concurrency in AWS when doing performance testing

  • Emily: parallel processing with multiple processes can slow system

down

  • Collin Brittle: set up autoscaling with sidekiq and EC2

  • Daniel Pierce: metrics feature of Fedora used at Emory to help investigate?

  • Collin Brittle: bottlenecks are lower, in infrastructure

  • Emily: haven't stress-tested Fedora yet; Fedora persistence seems to be quick and stable

  • Daniel will add Fedora metrics to docker compose

Daniel: use Postgres as Fedora database?

Dan Field: Postgres is most tested, but others also use MariaDB

Arran: Dan will release new RC, will get it into Fedora docker; then into Nurax, and performance testing will continue

Next meeting:

Scheduled for Dec 27th - proposal of a new meeting? Or wait until Jan?

Cancel Dec. 27th meeting; Arran will check in in early January to see where things are at; we'll

communicate asynchronously

 

  1. Cancel Dec. 27th meeting
  2. Arran will check in January to see where testing is at
  3. Dan Field will release updated RC, with encoded slash PR fix