Assessment and Evaluation

From Digital Scholarship Group
Jump to navigation Jump to search

Planning

Draft Assessment Plan December 2015

Tools in Use

Podio

Initial Planning

What does the library already collect pertinent to the DSG?

  • Numbers of items digitized (currently largely collected from Archives)
  • Workshops given, number of attendees (how would DSG vs. DSC discussions count here?)
  • Hours spent in consultation with faculty/grad (Library Administration is interested in being able to report a number of hours spent in support of faculty research)
  • Highlights for the library's Annual Report and other newsletters

What does the DSG currently track?

What is the "story" the DSG most wants to tell?

What are the services each person and team delivers?

How does the DSG define success?

Project success: How long does a project retain staff? When does a project start to maintain its own documentation? When does a project apply for and receive its own funding?

DSG technology impact: When are new structures and programs developed? When is DSG code re-used?

Graduate student development: How many conference presentations and posters are given by DSG grad students, related to DSG projects? How many workshops are designed and led by grad students?

DRS impact: How may new users? Deposits? Downloads? Enabled how many projects? Had how many code releases? Were any code releases re-used?

Grant funding: Amount awarded? Positions funded? Projects completed? New organizations worked with?

Website: DRS analytics? Google analytics? The library has an account for Google, there are privacy implications.

Other thoughts

How will the new Provost affect what the library reports upwards?

What do other DH-ish centers in libraries report? (NB: Amanda asked this question on a library DH email list, and received no response.)

What is the balance between helpful evaluation and burdensome statistics collecting?

Where are the pitfalls? When you start reporting numbers, there will be pressure to see those numbers increase every year.