Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-46111: Refactor and extend the documentation in the Qserv documentation tree #874

Merged
merged 1 commit into from
Nov 15, 2024

Conversation

iagaponenko
Copy link
Contributor

No description provided.

@iagaponenko iagaponenko force-pushed the tickets/DM-46111 branch 5 times, most recently from 71566f6 to 0490bec Compare November 3, 2024 22:42
@iagaponenko iagaponenko force-pushed the tickets/DM-46111 branch 2 times, most recently from 5c1de47 to 0271786 Compare November 9, 2024 05:55
Copy link
Contributor

@jgates108 jgates108 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, just minor comments.

There's a file with the heading "Secondary Index" which is probably out of date. There's at least one page with a head of "Director Index", so that should probably be sorted out.

Looking at this, it would be nice if there was a way to have it print the contents of a text link instead of the link for the hints and notes. Some duplicate text could be removed.

It looks like this may be possible with ".. include:: other_page.rst"

doc/ingest/intro.rst Outdated Show resolved Hide resolved
doc/user/async.rst Outdated Show resolved Hide resolved
doc/user/http-frontend-ingest.rst Show resolved Hide resolved
doc/user/http-frontend-ingest.rst Outdated Show resolved Hide resolved
doc/user/http-frontend-query.rst Outdated Show resolved Hide resolved
doc/ingest/api/concepts/transactions.rst Outdated Show resolved Hide resolved
doc/ingest/api/concepts/transactions.rst Outdated Show resolved Hide resolved
doc/ingest/api/concepts/publishing.rst Outdated Show resolved Hide resolved
doc/admin/director-index.rst Outdated Show resolved Hide resolved

The families are defined by the Replication/Ingest system and are not visible to Qserv users. Each family has a unique
identifier (name). The system uses family names to correctly distribute the data of partitioned tables among Qserv worker
nodes, ensuring that the data of tables joined in queries are co-located on the same worker node.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It may be a good idea to make a mechanism so qserv users can get lists of families.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This information is available via the following REST service of the Master Replication Controller:

GET /replication/config

Families are important mostly for the database administrators and those in charge of ingesting catalogs into Qserv. Exposing families via the SQL interface may be a bit tricky.

- Minor changes in the front page layout
- Eliminated obsolete documents in all sections
- Added the User's Guide for the asynchronous query interface
- Added the User's Guide for the HTTP frontend
- Updated Qserv Developer's Guide
- Added notes for building the sciSQL library for Qserv containers
- Added Administrator's guide on (re-)building the "director" indexes
- Added Administrator's guide on (re-)building  indexes on the data tables at workers
- Added the Ingest Workflow Developer's Guide
@iagaponenko iagaponenko merged commit f151af9 into main Nov 15, 2024
15 checks passed
@iagaponenko iagaponenko deleted the tickets/DM-46111 branch November 15, 2024 02:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants