How do I modify the upload file size restrictions in AEM Assets UI to prevent users from uploading larger files than a certain number of bytes?
Steps
Touch UI
See this documentation regarding setting sizeLimit property to restrict max file size for asset upload.
Classic UI
Unfortunately, in Classic UI there is no such feature.
This blog post mentions how you can customize the product to do this:
http://experience-aem.blogspot.in/2014/12/aem-6-sp1-classic-ui-restrict-large-or-small-files-upload.html
However, note that this customization is not supported by Adobe Customer Care. So if you implement this customization, then you would have to maintain it as part of your code base.