SafetyMode does not include a contact control function.
Fortunately, Google offers a contact control feature as part of Google Family Link.
You can access this function on the Google family link app on your parent phone under Controls > Contacts, calls & text.
Please note that for unknown reasons, Google Family Link occasionally does not offer contact controls to some users.