No. Mice are lactose intolerant and cannot digest dairy; cheese can be harmful.
Healthy mouse diet includes:
A varied diet meets their nutritional needs.