This study seeks to establish factors affecting tax compliance by Small and Medium Enterprises, with special emphasis on Income Tax and Value Added Tax and their effects on government revenue. Tax compliance level which is internal factor affecting tax revenue not only undermines tax administration infrastructure but also makes the tax base narrow and inequitable. The objectives of the study include establishing the influence of compliance cost, fines and penalties and attitudes of tax compliance among Small and Medium Enterprises. The study adopts a descriptive research design involving both qualitative and quantitative research methodology. The target population was 200, out of which a sample size of 132 respondents were drawn, using stratified and simple random sampling. Questionnaires were used to collect primary data from the respondents, which were analyzed using SPSS applying both descriptive and inferential analysis. There was a positive relationship between the tax and compliance cost (r=.514), fines and penalties (r=.415) attitudes (r=.546) and tax compliance. The findings showed that compliance cost, fines and penalties and attitude had significant relationship with tax compliance. It is recommended that the tax system should provide a clear and simple guideline on how to fill tax returns but also enhance taxpayer education services to enable the taxpayers understand their rights and obligations as taxpayers, there should be moderate levels of fines and taxes so that SMEs are encouraged to comply since they will keep accurate records for taxation purposes in order to avoid fines and penalties.