Hide Drupal login page and unused files from search engines

[cwbragg]

Is your feature request related to new functionality not yet included in the product? Please describe.
New.

1. https://libraries.emory.edu/user/login is discoverable via search engines.

2. Files not associated with items in the media library or associated with unpublished media items are findable via search engines. (see attached image)

Is your feature request related to a problem or a change to existing functionality? Please describe.
Problem.

1. The login page: Patrons are discovering the Acquia Drupal login page via search engines and creating Drupal accounts - they are most likely hoping to log into Library Search. The page is in the top twenty visit results, just behind the Library Search page.

2. Files: All pdfs in the Files collection are findable via search engines. This includes past hours, job postings, and policies.

Describe the solution you'd like

1. Permanently hide the login page (adding 'noindex'?) from search engines and share the URL only with staff.

2. Either automate file visibility so that if they are not associated with a media item/node they are unpublished/hidden, or; give the admin role the ability to delete files.

Describe alternatives you've considered

1. Remove the ability for non-library staff to login.
2. There doesn't seem to be an alternative for the files

How will this impact users?
Less confusion for patrons searching for "Emory Libraries login" in search engines.
Less confusion for patrons searching for current libraries and location hours in search engines.

Additional context
Add any other context or screenshots about the feature request here.
Screenshots of "emory library login" and hours search results; screenshot of GA4 page clicks for login and library search

[cwbragg]

@maxdmayhew hiding Site Studio login and other search results ticket updated.

[cwbragg]

Related to the file situation:

A thread on the issue:
https://www.drupal.org/project/drupal/issues/3027324

Module for giving editors option to delete file along with media item:
https://www.drupal.org/project/media_file_delete

The thread was interesting: the developers state that editors assume that deleting a media item also deletes the associated file.