Should the UK driving test becoming harder to pass?

We were having this debate in the pub last night.

For

Driving is not a right!! There are too many drivers on the road that clearly lack the basic skills and understanding of how to properly control a vehicle. Only recently a news article claimed that 20% of learners get their friends to do the test for them. We also live on a small island with limited road space therefore it would beneficial to limit the amount of new drivers coming onto the roads. Therefore the test should become harder to make sure those who are on the roads are competent; a limit should be set on the amount of times someone can take a test, extra criteria should be added to the test and restrictions should be set for the first two years of driving on the type of car you can own.

Against

The test is already stringent enough and forcing people to use alternative means to travel is only viable if there is a safe, efficient, affordable and reliable public transport system in place (which there isn't). If someone has done their lessons, taken their test and a qualified examiner deems them ready to have a licence then this should be sufficient enough.

What are your thoughts?

(I'll keep it to myself for now what side of the fence I come down on)