The specifics of the solution will depend on the specific access rules that you have in place but typically in cases like this something like the following is true.
The All Members group is often used for general access (especially in older digital workplace) and this group will always contain all members of the digital workplace so any user you add will have access to all of these areas.
If this is the case for the 5 folders you are looking restrict access to, you can simply remove the access rule for all members and replace it with another rule for a Member Group that you create that will also contain all the members that you need it too (in this case all your members but the temp user). Your new user will have typical access based on All members, but no access to the folders are they are not in this new group.
You can use this group to solve other temp user issues in the future. At some point it may also be worth not using the All Members group for access anywhere to gain more specific control over access.
If the above description does not fit the specific access structure of your digital workplace can I have you submit a ticket to email@example.com with the specifics and one of our Support agents can take a look.