When going through Somerset West I would recommend riding through somerset west main road / old sir lowry's road past Vergelegen Medi-clinic and then turning onto Mondeor road. This will allow you to miss a big part of the N2.
https://www.strava.com/routes/23657763
Ride in a big group and early with lights on at Sir Lowry's. Once you reach Grabouw turnoff you are home free.