We conducted an experiment in order to examine the effectiveness of an educational Web site, which provides resources to undergraduate students in mathematics. The participants' task was to solve 18 questions about differential equations. Students in the paper condition outperformed those in Web site conditions. There was no difference between the original and an improved Web site version. Moreover, students in all conditions preferred working with the paper resource. Practical and theoretical implications are discussed.