It is an undeniably fact that higher education is very important with regard to the development of the people / society and is, therefore, considered to be of top significance with regard to social and economic development of a country. To ensure and provide the quality education at the higher level what steps and factors are to be taken and followed is very important in this regard. To bring a quality change in the higher education system in Pakistan is not an easy job for the fact that in Pakistan there are about 161 universities and degree awarding institutes but none of them has got itself included in the list of top 500 universities of the world, even in top 100 universities of Asia. The basic objective was to examine the different factors, which have significantly contributed towards the quality enhancement of the higher education and a better link between it and quality education such as Teaching Staff, Standardized Curriculum, Examination System, Research Work, Administration and Communication Skill. The survey data was collected by using quantitative as well as qualitative research techniques by 300 respondents including faculty members, Administrators and Educationists of Fifteen (15) public and private sector universities located at KP, Islamabad and Punjab by using stratified random sampling approach. The study was non-contrived and cross-sectional in nature and was both causal and co relational. The SEM /Amos technique was applied for model fitting. The results show that communication skill, administration, curriculum and also other factors perform a significant impact in enhancing the quality of higher education.