Scribd Logo
Upload

Welcome to Scribd!

  • Digital Vita: The University of Pittsburgh's Research Networking System

    Uploaded by

    Titus Schleyer
    196 views33 pages
    Digital Vita (DV), a research networking application developed by the University of Pittsburgh, integrates CV management functions with academic social networking and basic research team management and collaboration functions. This presentation provides an update on the project as of November, 2011, and presents early results of an evaluation study.

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    PPT, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    Digital Vita (DV), a research networking application developed by the University of Pittsburgh, integrates CV management functions with academic social networking and basic research team management and collaboration functions. This presentation provides an update on the project as of November, 2011, and presents early results of an evaluation study.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    196 views33 pages

    Digital Vita: The University of Pittsburgh's Research Networking System

    Uploaded by

    Titus Schleyer
    Digital Vita (DV), a research networking application developed by the University of Pittsburgh, integrates CV management functions with academic social networking and basic research team management and collaboration functions. This presentation provides an update on the project as of November, 2011, and presents early results of an evaluation study.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 33

    Digital Vita: The University of Pittsburgh's Research Networking System

    Titus Schleyer, DMD, PhD Heiko Spallek, DMD, PhD Brian Butler, MS, PhD Linda Schmandt, MS et al.
    Titus Schleyer 2011

    How do scientists look for collaborators?


    ask colleague(s) and get a referral search the literature and cold-call use electronic systems, e.g. Community of Science

    Kraut RE, Galegher J, Egido C. Relationships and tasks in scientific research collaboration. Hum-Comput Interact 1987-1988;3(1):31-58.
    Digital Vita Titus Schleyer et al. 2 of 33

    Why dont scientists use expertise locating systems?


    1. 2. 3. 4. 5. low awareness incomplete domain coverage outdated/sparse profiles lack of critical mass traditional approaches very ingrained

    Digital Vita Titus Schleyer et al.

    3 of 33

    Scientists are not looking for a blind date.


    Collaboration
    is often a long-term relationship. requires predicting future performance. benefits from deep knowledge about the collaborator. can have significant professional impact. is sometimes hard to end.
    contrast to expertise location in traditional CSCW research
    Schleyer TK et al.. Conceptualizing and advancing research networking systems. ACM T Comput-Hum Int. 2012. (in press)
    Digital Vita Titus Schleyer et al. 4 of 33

    With regard to collaboration, scientists face an embarrassment of riches.


    science increasingly multi- and inter-disciplinary more collaborators through growing research enterprise collaborators easier to find through Google, MEDLINE, etc. remote collaborations increasingly practical

    Braun T, Schubert A. A quantitative view on the coming of age of interdisciplinarity in the sciences 1980-1999. Scientometrics 2003 Sep;58(1):183-9.
    Digital Vita Titus Schleyer et al. 5 of 33

    Plenty of expertise locating systems


    Community of Science (www.cos.com) LinkedIn (www.linkedin.com) Innocentive (www.innocentive.com) Index Copernicus Scientists
    (http://scientists.indexcopernicus.com/) (http://www.researchcrossroads.com/) (http://www.biomedexperts.com/) (http://www.vivoweb.com/)

    Research Crossroads BiomedExperts VIVO

    Direct2Experts

    (http://www.direct2experts.org/)

    Digital Vita Titus Schleyer et al.

    6 of 33

    Are current systems responsive to the requirements of scientists seeking collaborators?

    Titus Schleyer 2011

    Digital Vita Titus Schleyer et al.

    7 of 33

    Results

    Titus Schleyer 2011

    Digital Vita Titus Schleyer et al.

    8 of 33

    Ideation and concept validation

    Digital Vita Titus Schleyer et al.

    9 of 33

    Requirements
    effort balanced with perceived benefit profiles comprehensive and up-to-date exploit social network model proximity assessment of compatibility, work style and other soft traits

    Schleyer TK, et al. Requirements for expertise location systems in biomedical science and the Semantic web. Proceedings of the 3rd Expert Finder Workshop on Personal Identification and Collaboration; 2008
    Digital Vita Titus Schleyer et al. 10 of 33

    Requirements (cont.)
    social networks based solely on co-authorship incomplete accommodate preferences for privacy and public availability of information search effectively across disciplines facilitate non-intuitive connections

    Digital Vita Titus Schleyer et al.

    11 of 33

    Architecture

    Digital Vita Titus Schleyer et al.

    12 of 24

    Digital Vita live

    Digital Vita Titus Schleyer et al.

    13 of 33

    Implementation
    soft rollout beginning 10/2009 currently:
    815 users at Pitt, some elsewhere 8,045 total logins 28,139 publications 4,081 grants 11,495 presentations 4,376 mentoring records 770 biosketches
    14 of 33

    Digital Vita Titus Schleyer et al.

    Formative evaluation of DV
    Objective: assess adoption and use of Digital Vita since inception across six HSC schools
    quantitative and qualitative usage, attitudes, satisfaction and acceptance outcomes

    short-term: biosketch generation and routing, new research teams, efficiency gain long-term: high-impact collaborations formed, collaborative publications, external system utilization
    15 of 33

    Digital Vita Titus Schleyer et al.

    Formative evaluation of DV (cont.)


    Methods
    a cross-sectional , purposive sample 30-minute semi-structured interviews stratification factors: level of seniority (junior, midlevel and senior) and level of DV use (active, moderate and low) interviews recorded and notes taken

    Digital Vita Titus Schleyer et al.

    16 of 33

    Data analysis
    descriptive analysis of tracking data content analysis of interviews:
    general approach for managing CV software used to manage CV different uses of DV problems in using DV suggestions for system improvement

    Digital Vita Titus Schleyer et al.

    17 of 33

    Preliminary results: Quantitative

    Image mommamia/flickr 2011 Digital Vita Titus Schleyer et al.

    18 of 33

    1200

    1000

    800

    600

    Monthly logins Total users

    400

    200

    Digital Vita Titus Schleyer et al.

    20 09 -1 2 20 10 -0 2 20 10 -0 4 20 10 -0 6 20 10 -0 8 20 10 -1 0 20 10 -1 2 20 11 -0 2 20 11 -0 4 20 11 -0 6 20 11 -0 8 20 11 -1 0
    19 of 33

    User types
    Superdelegate
    Delegate Sole user

    bulk CV data entry for 550 people


    admin. support staff for center/dept. faculty faculty who do most work themselves

    1%
    4% 95%

    Digital Vita Titus Schleyer et al.

    20 of 33

    Size of CVs in Digital Vita


    250

    200

    150
    # users

    100

    50

    0 0 1-50 51-100 101-200 201-500 >500 My Information objects

    Digital Vita Titus Schleyer et al.

    21 of 33

    Sources for selected objects


    Entry Object type
    Poster Journal article Conference paper Published abstract Manual Propagated Import from from manual MEDLINE

    1,660 5,464 436 2,438

    94 4,942 63 627

    0 10,264 0 0

    Digital Vita Titus Schleyer et al.

    22 of 33

    Preliminary results: Qualitative

    Image MGShelton/flickr 2011 Digital Vita Titus Schleyer et al.

    23 of 33

    Motivators for updating CV


    common
    preparation for grant submission faculty annual evaluation new publications and presentations

    uncommon
    appointment to committees change in job responsibilities recruitment of students job search

    Digital Vita Titus Schleyer et al.

    24 of 33

    Traditional CV management
    software used for managing CV
    Microsoft Word, Adobe Acrobat, Latex

    problems with Word


    formatting laborious accuracy likely compromised by copying and pasting difficult to keep track of new publications difficult to create other documents based on CV

    Digital Vita Titus Schleyer et al.

    25 of 33

    DV description/impressions
    positive
    database/data warehouse data repository/central repository Internet-based/online/electronic streamline/simplify CV management versatile, flexible, efficient

    negative (1 user)
    unyielding/cumbersome interface disruptive

    Digital Vita Titus Schleyer et al.

    26 of 33

    Current uses
    mostly entering information into the system created CV for various purposes (5 users) created NIH biosketches for grant (6 users) used Search to look for people (1 user) colleague requests (2 users)

    Digital Vita Titus Schleyer et al.

    27 of 33

    Features liked and problems


    features liked
    automatic import of publications from PubMed easy biosketch creation entering information straightforward

    common problems
    import of irrelevant publications difficult to categorize some info (e.g. letter to editor) confusion about publication updates difficult to edit/format output documents
    Digital Vita Titus Schleyer et al. 28 of 33

    Suggestions for improvement


    reduce number of irrelevant research interests in profiles import publications more accurately interface with other Pitt systems implement recommendations remind user to update bold authors name in publication lists customize CV format for each school integrate dictation software (Dragon)
    Digital Vita Titus Schleyer et al. 29 of 33

    Barriers to the implementation of Digital Vita


    Well-connected researchers will outperform system most of the time. Collaboration-seeking methods and needs evolve with scientists career. DV economizes on many tasks but adds others. The desire for publicness differs among scientists. and many other problems associated with social networks (e.g. free ridership, differential incentives, etc.).
    Digital Vita Titus Schleyer et al. 30 of 33

    Discussion
    collaboration-seeking a complex activity does not depend on solely factual information about potential collaborators current approaches to finding collaborators time- and effort-intensive CV a good source of factual information

    Digital Vita Titus Schleyer et al.

    31 of 33

    Project Website

    http://di.dental.pitt.edu/orc/
    Address of this talk
    http://scr.bi/vugrGV

    Digital Vita Titus Schleyer et al.

    32 of 33

    Thank you for your attention. Questions?

    Titus Schleyer 2011

    Digital Vita Titus Schleyer et al.

    33 of 33 (finally!)

    You might also like