Access limitations • Restrictions on access to court proceedings, documents, and files may provide less opportunity and information to perform in-depth analysis of issues characteristic of open reports. Number of reports • As reports increase, conclusions • As reports increase, information management is less problematic may be more definite, but as more data directly increases the management of all information credibility of findings. becomes more difficult with greater chance that case information will not be utilized. Short monitoring time frame/few cases • Detailed analysis of individual cases and highlighting of problems may provide a basis for reporting in emergent situations. • Questionnaire format provides a capacity to compile reliable information across many cases to make conclusions on specific issues without access to the entire record of an individual case. • Conclusions based upon quantitative analysis require a longer time frame to monitor a sufficient number of cases to make reliable findings. Monitor experience • Requires more monitoring experience to spot issues and independently apply standards to formulate conclusions. • Questionnaire provides more structure for monitors resulting in more consistent issue coverage. Strengths/ weaknesses • Objective survey approach may provide quantifiable findings regarding how a system functions; • Allows collection of data on widespread and select issues during a monitoring term; • Danger regarding a lack of depth of analysis and that nuances may be lost; • Difficult to assess quality of data on some issues; • More difficult to provide in-depth and complete public reporting on individual cases. • Excellent where programme seeks to take an in-depth look at proceedings in individual cases or focuses on a narrow set of issues with a high level of analysis; • Making systemic conclusions may not always be supported by methodology; • Greater tendency that monitors may focus on different issues given wider discretion in reporting; • Danger regarding undue focus on problem issues to exclusion of good practices, as monitors focus on reporting violations. 6.3.4 Hybrid formats – open organized format An open organized format is open in the sense that, like an open report form, it requires the provision of narrative analysis on issues based upon the discretion of the monitor. As opposed to a pure open report, however, an open organized template is more tightly organized around discrete issues, permitting more consistent issue coverage and easier compilation of findings on such issues. Such a format may be helpful for a programme that wishes to retain the possibility of in-depth case analysis while also monitoring a 74 Trial-Monitoring: A Reference Manual for Practitioners