When these are off-topic, what is the use of voting them? (IMHO They should be VTC rather than an upvote. Only few people are participating in review.)
Whenever you see a question that doesn't fit as per the scope of site, it is encouraged to vote/flag to close it. VTC is very important moderation privileges as it keeps the site clean of unnecessary posts. Similarly reviewing is a good job of moderating the site. If we've inadequate users participating to review queues, we should draw attention to high reputation users regarding it by explaining the importance of it.
Now, talking about upvoting and downvoting off-topic questions, You'll find the general idea from tool-tip (hover the mouse over buttons):
Upvote: "This question shows research effort; it is useful and clear"
Downvote: "This question does not show any research effort; it is unclear or not useful."
In other words, Upvote encourages users to ask such type of questions whereas Downvote discourages users to ask such type of questions.
When the question is off-topic:
- You should alwaysencouraged consider to VTC (vote/flag to close)
- You may also consider to downvote altogether to discourage asking such type of questions.
- If question is well researched, you may upvote it.
Related posts on MSE: Dealing with off-topic questions, Should an off-topic question always be downvoted?