Is the publisher a member of Open Access Scholarly Publishers Association (OASPA)? OASPA consists of a group of open access publishers, which are recognized for promoting and advocating open access publishing. Please see the list of OASPA members here. Newer publishers are not listed in OASPA, so it will be more appropriate to evaluate them based on their reputation in the related academic community.
What is the mandate of the publisher of the journal? Is it for-profit or not-for-profit? The mandate of the publisher often can be found on their website. Not-for-profit publishers may have deeper commitment to open access, as they focus on scholarship and the dissemination of information rather than profit.
Evaluating open access journals is relatively new for many researchers and scholars. If you need any assistance or have any questions, feel free to contact us for help.