1. We do not have a psychometrician in house, but we do work frequently with a psychometrician on behalf of a number of other regulated health professions. Are we invalidated from bidding since there is a specific stipulation in the RFP that “The described services are to be provided by one organization”?
Answer: Please elaborate on the frequency that the psychometrician works with your organization in your proposal.
2. Can you define for me what you mean by security? The key question is whether you have in mind online learning and an online exam that is accessible from a members’ computer from any location or whether you have in mind an examination that can only be accessed from a secure, controlled location with dedicated computers that are controlled by a proctor?
Answer: Please elaborate on the security you recommend in your proposal.
3. Are you open to having more than 60 questions in the exam?
Answer: Please explain why you think there should be more (or less) than 60 questions in the exam.
4. Is it possible to view the content that has already been developed for your existing jurisprudence learning events?
Answer: Please refer to this document (PDF), available on the College website under the Resources tab.
5. Can you expand more on the timing of the project; specifically, when do you want to “go live”?
Answer: If there is no specific timing mentioned in the RFP, please indicate the timing your organization is able to meet.
6. Approximately how many candidates are expected to take the Jurisprudence exam in a given year, or perhaps what is the average number of candidates per exam administration?
Answer: In 2015, there were a total of 121 Jurisprudence exam candidates or an average of 20 candidates per exam administration. In 2016, there were a total of 132 Jurisprudence exam candidates or an average of 22 candidates per exam administration.
7. Please describe the current delivery methods (in-class or online) for the jurisprudence seminar and exams.
Answer: Please refer to the information contained in the RFP.
8. What are the reasons for transitioning into an online seminar and exam?
Answer: The goal is to provide greater accessibility to the jurisprudence seminar and increased opportunities for applicants for registration with the College, to challenge the jurisprudence exam. It would also facilitate updating the seminar content and reflecting subsequent changes to the exam. Having the seminar and exam online would also enable in-depth statistical reporting.
9. Are there any concerns about the final implementation or preconceived ideas about the method of implementation?
Answer: Please refer to the specifications mentioned in the RFP.
10. A requirement in the Scope of Work is for the supplier to “integrate appropriate software, accommodate audio, including voiceover, and image development.”
1. Is there any other software that would need to be integrated with the final product (a deliverable of this RFP)? If so, please identify the software.
2. Are a voiceover player and recorder part of the final product? Who will record and play the audio? When (during exam or when)?
3. Is image development (sourcing, designing, or creating illustrations, charts, diagrams, or videos) part of the final product? Who will use the image development tool? When (during exam or when)?
Answer: Please elaborate in your proposal on the software, audio, and image development you recommend using and why. The final product needs to be appropriate for the intended purpose.
11. Are there cost constraints for the development and implementation of the product?
Answer: Please refer to the RFP document.
12. Is it okay to quote on a per-man-hour basis?
Answer: Please provide costs in Canadian dollars and explain how the costs were derived. Per diem and hourly rates are to be provided.
13. We work with either in-house development (at our end) or in-premises (our staff at your place). Are there any restrictions on this?
Answer: In-house development can be assumed to require a certain degree of interaction with College staff.
1. In addition to the Resource Binder, is there any additional content available to be used to develop the online course (i.e., seminar outlines, agenda, presentation slides, facilitation guides, or reference materials)?
Answer: Additional content can be provided to the successful vendor/respondent who is awarded the contract(s) associated with the RFP.
2. Is the live seminar currently presented in French? Are the Resource Binder and any additional content available in French?
Answer: The live seminar, the Resource Binder, and any additional content are currently available in English.
3. Can you confirm all of the content for the online course is contained in the existing instructor-led session and that no additional research is required to develop addition new content?
Answer: The content for the jurisprudence seminar (currently available under the Resource tab of the College website) is what is provided to candidates registered for the jurisprudence seminar and exam.
4. Will the successful vendor be permitted to attend a live seminar session prior to developing the online course?
Answer: The successful vendor/respondent will be permitted to attend a live seminar session during the development of the online course.
5. How long is the in-person seminar and can you provide an outline of the content covered in the in-person seminar?
Answer: The in-person seminar is from 9:00 a.m. to 3:30 p.m.
6. What is the anticipated or maximum learner time for this course?
Answer: Please assume an appropriate learner time as needed.
7. Do your learners have accessibility requirements? If so, what is the level of accessibility required or legislated?
Answer: Please refer to the Ontarians with Disabilities Act, 2001, as applicable.
8. The cost of elearning development is closely tied to its level of interactivity (i.e., higher interactivity = higher costs). Please describe the level of interactivity you expect for your elearning course (i.e., custom video/photos, illustrations, audio/narration, graphics, etc.).
Answer: Please elaborate on the recommended interactivity in the proposal.
1. Is the exam a one-time examination for new applicants to register as optometrists in Ontario or are College members (registered optometrists) required to retake the exam (for example, once every three years) to maintain registration status?
Answer: Currently, applicants for registration as optometrists in Ontario may challenge the exam more than once until they successfully pass it. College members are not currently required to retake the exam to maintain their registration status.
2. The RFP indicates that “each exam consists of 60 multiple-choice questions.” How many total exam questions currently exist/is there a larger existing pool of questions? And will these existing questions be provided to the selected vendor for use in the online exam(s)?
Answer: There is a larger existing pool of questions which can be provided to the successful vendor/respondent for use in the online exam(s).
3. Can you please provide more details regarding the current exam questions? For example, do they require a subject matter expert to assess written answers or are they simply multiple choice or another format that can be easily scored electronically?
Answer: The current exam questions are all multiple choice questions that can easily be scored electronically.
4. The RFP indicates “a candidate’s report for each exam administration which clearly indicates the questions which were changed for that exam administration.” This implies that exam questions will change for each exam administration. Would the College accept having a psychometrician assist in the development of a pool of questions, of which 60 questions would be randomly selected each time?
Answer: Please refer to page 3 of the RFP.
5. The RFP indicates “Exam Reliability and Security,” “minimizing exam breaches.” Is the College expecting the proponent to provide a fully secure online proctored solution that will include specialized online proctoring software for identification verification and full physical environment and computer monitoring, or would a simple solution using a virtual online application like “GoToMeeting,” to monitor the student, suffice?
Answer: Please elaborate on the recommended security in the proposal.
6. Are the current exams offered in English and French?
Answer: The exams have been offered in French by specific request in the past.
7. Would it be okay to provide a per hour/per diem rate for our psychometricians with just an estimate of overall cost based on what we know at this point?
Answer: Please elaborate on your psychometricians’ rate in your proposal and provide an estimate of the overall cost based on the information known at this point.
Please note: Due to exam confidentiality and security concerns, responses will not be provided to certain exam questions received. However, responses will be discussed with the successful vendor/respondent.
1. Does the College require that a final version of the online seminar complete with audio files and timed animations be piloted? Or can a pre-audio production version of the online seminar (with on-screen audio transcripts) be piloted to ensure that audio narration is only recorded once?
Answer: Please elaborate on the suggested pilot in your proposal.
2. Will the College receive and coordinate feedback from the pilot participants and provide the vendor with one set of final feedback? Or will the vendor be responsible for gathering and verifying feedback from multiple pilot participants?
Answer: The College can receive and coordinate feedback from pilot participants.
3. How many participants are expected to be involved in the pilot phase?
Answer: Please elaborate in your proposal about how you would suggest the jurisprudence pilot could unfold.