If the brake shoes are contaminated you will have to clean them or replace the. When mine leaked I was not able to get the brake to hold and it rolled down a driveway.
You may have a bad seal and is getting past it and leaking inside the drum. Get a rebuild kit and a new seal and that should take care of it. Get a speedy sleeve just in case the shaft is worn.