Formative Evaluation Questionnaire of HealthCyberMap Pilot Implementation

This is a questionnaire to evaluate HealthCyberMap pilot implementation (this is a formative or initial evaluation of concepts in their infancy rather than of a full-blown service). We request anonymous information about your background and ask some evaluation questions. Responding to the questionnaire should take about 30 minutes to complete. Thank you very much for your time and input.

I know what you mean...About HealthCyberMap

HealthCyberMap (https://healthcybermap.semanticweb.org) is a Semantic Web project that aims at mapping parts of medical/health information resources in cyberspace in novel semantic ways to improve their retrieval and navigation. The Semantic Web (http://www.w3.org/2001/sw/ and http://www.semanticweb.org) aims to be the next-generation World Wide Web by giving machine-readable semantics and context to the currently presentation-based Web pages so that, for example, a search for resources on Mr. Wood does not return results on tree wood. Follow this link to learn more about HealthCyberMap.

We subscribe to the HONcode principles of the HON Foundation. Click to verify.We subscribe to the HON code principles. Verify here.

You may also wish to read our privacy statement.


Questions (You may leave blank any question you don't want to answer)

Question 1. Gender:

Male
Female

Question 2. Which of the following categories includes your age:

Under 18
18 - 25
26 - 35
36 - 45
46 - 65
Over 65

Question 3. What is the highest level of education you completed:

School
University/College
Postgraduate
Vocational training

Question 4. Which of the following best describes you:

Member of the general public seeking health-related information
Member of the general public touched by disease
General practitioner
Hospital doctor
Nurse
PAM/AHP (Allied Health Professional)/other healthcare professional
Scientist/researcher
Medical librarian
Other

Question 5. How many hours per week, including work and home, do you currently use the Internet:

Less than 5 hours
More than 5 hours

Question 6. Regularly used a computer:

Not at all
Few weeks
2-6 months
6-24 months
>2 years

Question 7. Regularly used the Internet using a browser (e.g., Netscape, Internet Explorer):

Not at all
Few weeks
2-6 months
6-24 months
>2 years

Question 8. Do you have a working personal computer (PC) in your home:

Yes
No

Question 9. From which location are you most likely to use the Web:

Home
Work
School
Library
Other

Question 10. What type of Internet connection do you have currently (if you use more than one type of connection in different places, select the one you use most):

Modem
ISDN/ADSL/Broadband/Always connected

Question 11. What web browser do you use most frequently:

Microsoft Internet Explorer
Netscape Navigator or Communicator
Other

Question 12. Which version of the browser do you use most frequently:

Version 3.x
Version 4.x
Version 5.x
Version 6.x
Other

Question 13. The Desktop Area/Screen Resolution you most commonly use is:

640 by 480 pixels
800 by 600 pixels
1024 by 768 pixels or more

Question 14. Which operating system are you currently running on your primary (most frequently used) PC:

Windows
Macintosh
Unix/Linux
WebTV
Other

Question 15. Do you consider the Internet an important source of reliable medical/health-related information:

Not at all
To some extent
Definitely

Question 16. How often have you accessed HealthCyberMap Web site over the past 3 months:

Daily
Weekly
Monthly
This is the first time I have accessed the Web site

Question 17. How did you hear about HealthCyberMap (Choose the one that best applies to the first way you learned about HealthCyberMap):

I listened to a presentation/read a paper on the project
A colleague told me about it
I received a notice through e-mail/e-mail list
I came across HealthCyberMap on the Internet (search engine, link from other site)
I am a personal friend or relative of researcher involved in this project
Other

Question 18. As a pilot system, HealthCyberMap does not include an exhaustive coverage of all medical/health conditions. Based on what you have seen so far, if HealthCyberMap was fully developed to provide a more complete coverage, would you use it as an information portal and one-stop access point to a variety of medical and health-related resources:

Yes
No

Question 19. HealthCyberMap concepts and interfaces meet my information retrieval and navigation needs (not topical coverage) better than other medical/health information portals/gateways:

Strongly disagree
Disagree
Neither disagree nor agree
Agree
Strongly agree

Question 20. (Only if you did not agree with the above statement) At this time, what other medical/health portals/gateway are better than HealthCyberMap regarding information retrieval and navigation (not topical coverage)


Question 21. I prefer to use a conventional search engine (e.g., Google) to gather information or to have a librarian, staff member, or family member gather information for me:

True
False

Question 22. How well does each of the six information interfaces featured in the current HealthCyberMap pilot perform its intended purpose? (Please rate each of the information interfaces from "not at all well" to "extremely well" considering aspects like ease of access, use and navigation, and logical arrangement of information on the pages of concerned interfaces)

Question 22.1. HealthCyberMap world maps of Web resources classified according to geographic provenance:

Not at all well
Slightly well
Somewhat well
Very well
Extremely well

Question 22.2. HealthCyberMap BodyViewer maps of Web resources classified according to medical/health topics:

Not at all well
Slightly well
Somewhat well
Very well
Extremely well

Question 22.3. HealthCyberMap textual resource index using ICD-9-CM top-level categories of medical/health topics:

Not at all well
Slightly well
Somewhat well
Very well
Extremely well

Question 22.4. HealthCyberMap map of Web resources classified according to resource type, e.g., audio-visual material, interactive resources, digital atlases, fact sheets, guidelines, etc.:

Not at all well
Slightly well
Somewhat well
Very well
Extremely well

Question 22.5. HealthCyberMap Web resources classified according to resource language:

Not at all well
Slightly well
Somewhat well
Very well
Extremely well

Question 22.6. HealthCyberMap semantic subject search engine (about this engine):

Not at all well
Slightly well
Somewhat well
Very well
Extremely well

Question 23. Did you find the meanings of the human body icons on HealthCyberMap BodyViewer maps familiar to you:

Yes
Somewhat (not always)
No

Question 24. Selecting the right words for search, and finding the right areas/icons to click on the maps was:

Very difficult
Difficult
Of moderate (acceptable) difficulty
Easy
Very easy

Question 25. How important/useful to you is each of the six information interfaces featured in the current HealthCyberMap pilot (Please rate each of the information interfaces from "not at all important" to "extremely important")

Question 25.1. HealthCyberMap world maps of Web resources classified according to geographic provenance:

Not at all important
Slightly important
Somewhat important
Very important
Extremely important

Question 25.2. HealthCyberMap BodyViewer maps of Web resources classified according to medical/health topics:

Not at all important
Slightly important
Somewhat important
Very important
Extremely important

Question 25.3. HealthCyberMap textual resource index using ICD-9-CM top-level categories of medical/health topics:

Not at all important
Slightly important
Somewhat important
Very important
Extremely important

Question 25.4. HealthCyberMap map of Web resources classified according to resource type, e.g., audio-visual material, interactive resources, digital atlases, fact sheets, guidelines, etc.:

Not at all important
Slightly important
Somewhat important
Very important
Extremely important

Question 25.5. HealthCyberMap Web resources classified according to resource language:

Not at all important
Slightly important
Somewhat important
Very important
Extremely important

Question 25.6. HealthCyberMap semantic subject search engine (about this engine):

Not at all important
Slightly important
Somewhat important
Very important
Extremely important

Question 26. Do you find HealthCyberMap map interface help (and other instructions/help hints around the site) adequate:

Yes, HealthCyberMap is easy to use once you understand how it works; the online help and instructions provided were useful
HealthCyberMap is very easy to use; I didn’t need any help (or made very little use of it)
No, I need more help to locate the information I need on HealthCyberMap Web site

Question 27. The speed at which HealthCyberMap maps load on my Internet connection is:

Reasonably fast
Slow

Question 28. Now, your task is to find information resources about specific diseases using HealthCyberMap. Choose at least one disease from the following list: prostate cancer, Crohn's disease, Guillain-Barre syndrome, amyotrophic lateral sclerosis, diabetes mellitus, Mitral valve prolapse, ectopic pregnancy (or any other medical/health topic(s) of your choice). On the average (if you tried finding resources on more than one disease), how successful were you in completing this task:

Successful from the first attempt
Successful after one or more failed attempts
Not successful

Question 29. What interface did you use most of the time to accomplish the above task:

BodyViewer maps of Web resources classified according to medical/health topics
HealthCyberMap textual resource index using ICD-9-CM top-level categories of medical/health topics
HealthCyberMap semantic subject search engine (advanced keyword search)
All three interfaces were equally useful

Question 30. The pointers to information resources returned by HealthCyberMap were relevant to my queries (i.e., to search words I entered or map areas I have clicked):

Strongly agree
Agree
Neither agree nor disagree
Disagree
Strongly disagree

Question 31. HealthCyberMap pointers to information resources are of good quality, accurate, up-to-date and useful:

Strongly agree
Agree
Neither agree nor disagree
Disagree
Strongly disagree

Question 32. When I look for information in HealthCyberMap I get overloaded quickly with too much detail (presentation format):

Not at all a problem
A slight problem
A moderate problem
A significant problem
An extreme problem

Question 33. Do you think visual maps are a useful addition to/complementary improvement over conventional text-based Web portal interfaces:

Yes, definitely
Could be an improvement (but not always)
No, visual interfaces are useless

Question 34. Compared to the mapping approach of map.net, do you think (e.g., regarding the use of familiar metaphors and presentation format of resource details and links):

HealthCyberMap approach is superior
HealthCyberMap approach is somewhat better
HealthCyberMap approach is about the same
HealthCyberMap approach is somewhat worse
HealthCyberMap approach is inferior
Do not have an opinion

Question 35. How important/ useful do you think are the proposed HealthCyberMap future interfaces/possibilities/concepts

Question 35.1. Multi-axial classification of resources based on two or more Dublin Core metadata elements:

Not at all important
Slightly important
Somewhat important
Very important
Extremely important

Question 35.2. HealthCyberMap customisation/detecting user location for location-based customisation:

Not at all important
Slightly important
Somewhat important
Very important
Extremely important

Question 35.3. Problem to knowledge linking (clinical codes as knowledge hooks):

Not at all important
Slightly important
Somewhat important
Very important
Extremely important

Question 35.4. Mapping health problems in HealthCyberMap and identifying information needs and gaps:

Not at all important
Slightly important
Somewhat important
Very important
Extremely important

Question 36. Do you think it would be useful in a future implementation of HealthCyberMap to also organise information resources by user needs/intended primary audience as patients, health professionals, or basic researchers:

Yes
No

Question 37. Were there any parts of the service that you found especially helpful? What do you like most about HealthCyberMap and why?


Question 38. Were there any parts of the service that you found especially difficult to use or understand? What do you dislike most about HealthCyberMap and why?


Question 39. Should resources (if available) be invested to continue developing and implementing HealthCyberMap? Why or why not?


Question 40. What are your suggestions or comments about what would make the service better? (e.g., I would like the following added to, changed in, or deleted from HealthCyberMap)


Question 41. Finally we would like to hear your thoughts about this questionnaire. For example, are we asking the right questions? Are we asking the questions in the right way? Your feedback will help us design better questionnaires in the future:


Please submit your responses by clicking the "Save" button below. Again, thank you very much for your time and input.


Back to Home Page

© 2001, 2002 HealthCyberMap.org. All Rights Reserved. (Last revised 17 April 2002)