python/provision: Create private dir if it didn't exist yet.