Yes, First create your 404 error page not found page then place it in each directory on your site. In htaccess, you would write a single line: ErrorDocument 404 pathtofile/

Then you would have to make a customized 404 file in htaccess.