The very base ingredients in vinyl spray cleaners are isopropy alcohol and distilled water. These can be found at any store which supplies chemicals, as well as at most drugstores. Preferences for mixing vary, but generally, one part isopropyl to three parts water is the standard for all home record cleaner sprays. Empty spray bottles are cheap and can be found at the same places, but if you don't have one or don't want to spring for one, you can use an empty Elmer's glue bottle too--anything with a small opening to allow judicious application will do.
The most popular variants in the basic formula involve the inclusion of detergent or professional photo fluids. Simple dish detergent can be used (Lysol all-purpose is a common choice) by adding two to five drops to the solution to get out deep dirt. Kodak Photo-flo is the most common alternative and can be purchased at any photo supply store; two to five drops is also recommended.