Yes it most certainly does. I help out at sourceforge and on various other open source projects because it is fun and it looks good on your resume as well. You do need to know how to program to help out so there definitely is something to it. You could also test software if you can't program but that won't really look good on a resume unless you are a software tester.
So if you can program go and help out.