When selinux was enabled I had a strange issue, my ssh key wasn’t working. When checking the sshd logs by putting DEBUG instead of INFO in LogLevel in /etc/ssh/sshd_config I saw that the ssh key was forbid to read by the system.
By doing ls -Zal I saw that the /home was unlabeled:
drwxr-xr-x. 3 system_u:object_r:unlabeled_t:s0 root root 20 Apr 12 17:14 home
running chcon -R -t user_home_t home solved the issue