[Sigifp-l] Fwd: Asis-l Digest, Vol 118, Issue 2
Brandi Loveday
blloveday at gmail.com
Mon Jul 7 12:44:32 EDT 2014
---------- Forwarded message ----------
From: <asis-l-request at asis.org>
Date: Jul 7, 2014 11:54 AM
Subject: Asis-l Digest, Vol 118, Issue 2
To: <asis-l at asis.org>
Cc:
Send Asis-l mailing list submissions to
asis-l at asis.org
To subscribe or unsubscribe via the World Wide Web, visit
http://mail.asis.org/mailman/listinfo/asis-l
or, via email, send a message with subject or body 'help' to
asis-l-request at asis.org
You can reach the person managing the list at
asis-l-owner at asis.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Asis-l digest..."
Today's Topics:
1. Announcing MIREX Grand Challenge 2014: User Experience
(GC14UX) (Downie, J Stephen)
2. Nominations for SIG publication of the year due July 15!!
(Kathryn La Barre)
3. Organization and Access of Big Data - Yonsei Workshop July
17-18 (Robert [Bob] Allen)
----------------------------------------------------------------------
Message: 1
Date: Tue, 1 Jul 2014 22:19:19 +0000
From: "Downie, J Stephen" <jdownie at illinois.edu>
To: "community at ismir.net" <community at ismir.net>
Cc: "evalfest at lists.lis.illinois.edu"
<evalfest at lists.lis.illinois.edu>
Subject: [Asis-l] Announcing MIREX Grand Challenge 2014: User
Experience (GC14UX)
Message-ID:
<612008895BFFF74BB7C7A74B2681CE61692A2606 at CHIMBX1.ad.uillinois.edu>
Content-Type: text/plain; charset="us-ascii"
Dear MIR Colleagues:
We at MIREX (Music Information Retrieval Evaluation eXchange) are very
proud to announce that we have posted the official Grand Challenge 2014:
User Experience (GC14UX) task description at:
http://www.music-ir.org/mirex/wiki/2014:GC14UX
=Purpose=
Holistic, user-centered evaluation of the user experience in interacting
with complete, user-facing music information retrieval (MIR) systems.
=Goals=
1. To inspire the development of complete MIR systems.
2. To promote the notion of user experience as a first-class research
objective in the MIR community.
=Dataset=
A set of music 10,000 music audio tracks is provided for the GC14UX. It
will be a subset of tracks drawn from the Jamendo collection's CC-BY
licensed works (http://www.jamendo.com/en/welcome).
The Jamendo collection contains music in a variety of genres and moods, but
is mostly unknown to most listeners. This will mitigate against the
possible user experience bias induced by the differential presence (or
absence) of popular or known music within the participating systems.
As of May 20, 2014, the Jamendo collection contains 14742 tracks with the (
http://creativecommons.org/licenses/by/3.0/ CC-BY license). The CC-BY
license allows others to distribute, modify, optimize and use your work as
a basis, even commercially, as long as you give credit for the original
creation. This is one of the most permissive licenses possible.
The 10,000 tracks in GC14UX will be sampled (w.r.t. maximizing music
variety) from the Jamendo collection with CC-BY license and made available
for participants (system developers) to download to build their systems.
=Participating Systems=
Unlike conventional MIREX tasks, participants are not asked to submit their
systems. Instead, the systems will be hosted by their developers. All
participating systems need to be constructed as websites accessible to
users through normal web browsers. Participating teams will submit the URLs
to their systems to the GC14UX team.
To ensure a consistent experience, evaluators will see participating
systems in fixed size window: 1024x768. Please test your system for this
screen size.
See the evaluation webform on the task wiki for a better understanding of
our E6K-inpsired evaluation system design.
==Potential Participants==
Please put your names and email contacts in the place provided on the task
wiki page. It is encouraged that you give your team a cool name!
=Evaluation=
As written in the name of the Grand Challenge, the evaluation will be
user-centered. All systems will be used by a number of human evaluators and
be rated by them on several most important criteria in evaluating user
experience.
==Criteria==
Note that the evaluation criteria or its descriptions may be slightly
changed in the months leading up to the submission deadline, as we test it
and work to improve it.
Given the GC14UX is all about how users perceive their experiences of the
systems, we intend to capture the user perceptions in a minimally intrusive
manner and not to burden the users/evaluators with too many questions or
required data inputs. The following criteria are grounded on the literature
of Human Computer Interaction (HCI) and User Experience (UX), with a
careful consideration on striking a balance between being comprehensive and
minimizing evaluators' cognitive load.
Evaluators will rate systems on the following criteria:
1. OVERALL SATISFACTION: Overall, how do rate the experience of using this
system?
2. LEARNABILITY: How easy was it to figure out how to use the system?
3. ROBUSTNESS: How good is the system's ability to warn you when you're
about to make a mistake and allow you to recover?
4. AFFORDANCES: How well does the system allow you to perform what you want
to do?
5. PRESENTATION: How well does the system communicate what's going on? (How
well do you feel the system informs you of its status? Can you clearly
understand the labels and words used in the system? How visible are all of
your options and menus when you use this system?)
6. OPEN TEXT FEEDBACK: An open-ended question is provided for evaluators to
give feedback if they wish to do so.
==Evaluators==
Evaluators will be users aged 18 and above. For this round, evaluators will
be drawn primarily from the MIR community through solicitations via the
ISMIR-community mailing list. The evaluation assignment webform developed
by the GC14UX team will ensure all participating systems will get equal
number of evaluators.
==Task for evaluators==
To motivate the evaluators, a defined yet open task is given to the
evaluators:
"You are creating a short video about a memorable occasion that happened to
you recently, and you need to find some (copyright-free) songs to use as
background music."
The task is to ensure that evaluators have a (more or less) consistent goal
when they interact with the systems. The goal is flexible and authentic to
the evaluators' lives ("a recent, memorable occasion"). As the task is not
too specific, evaluators can potentially look for a wide range of music in
terms of genre, mood and other aspects. This allows great flexibility and
virtually unlimited possibility in system design.
Another important consideration in designing the task is the music
collection available for this GC14UX: the Jamendo collection. Jamendo music
is not well-known to most users/evaluators, whereas many more commonly seen
music information tasks are more or less influenced by users' familiarity
to the songs and song popularity. Through this task of "finding
(copyright-free) background music for a self-made video", we strive to
minimize the need of looking for familiar or popular music.
==Evaluation results==
Statistics of the scores given by all evaluators will be reported: mean,
average deviation. Meaningful text comments from the evaluators will also
be reported.
==Evaluation Webforms==
To facilitate the evaluators and minimize their burden, the GC14UX team
will provide a set of evaluation forms which wrap around the participating
systems. As shown in the following image, the evaluation webforms are for
scoring the participating systems, with their client interfaces embedded
within an iframe in the left side of the webform. Wireframe examples of the
webforms are posted on the task wiki.
=Organization=
==Important Dates==
*July 1: announce the GC
*Sep. 21st: deadline for system submission
*Sep. 28th: start the evaluation
*Oct. 20th: close the evaluation system
*Oct. 27th: announce the results
*Oct. 31st: MIREX and GC session in ISMIR2014
==What to Submit==
A URL to the participating system.
==Contacts==
The GC14UX team consists of:
J. Stephen Downie, University of Illinois (MIREX director)
Xiao Hu, University of Hong Kong (ISMIR2014 co-chair)
Jin Ha Lee, University of Washington (ISMIR2014 program co-chair)
Yi-Hsuan (Eric) Yang, Academic Sinica, Taiwan (ISMIR2014 program co-chair)
David Bainbridge, Waikato University, New Zealand
Kahyun Choi, University of Illinois
Peter Organisciak, University of Illinois
Inquiries, suggestions, questions, comments are all highly welcome! Please
contact Prof. Downie <jdownie at illinois.edu> or anyone in the team.
**********************************************************
"Research funding makes the world a better place"
**********************************************************
J. Stephen Downie, PhD
Associate Dean for Research
Professor
Graduate School of Library and Information Science
University of Illinois at Urbana-Champaign
[Vox/Voicemail] (217) 649-3839
------------------------------
Message: 2
Date: Sun, 6 Jul 2014 10:54:18 -0500
From: Kathryn La Barre <klabarre at illinois.edu>
To: "sig-l at asis.org" <sig-l at asis.org>, "asis-l at asis.org"
<asis-l at asis.org>
Subject: [Asis-l] Nominations for SIG publication of the year due July
15!!
Message-ID:
<CAKTgfmXbzAoVc3GrhMboydbhSgqJcLdcqnhPVu_u7hE3=-edpA at mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Reminder: Deadline is July 15th!
Full details and the submission area is here:
http://www.asis.org/awards/sigpublicationoftheyear.html
What is an eligible publication?
Any type of SIG Publication including newsletters, transactions,
directories, or other publications.
To be considered, a publication must be in a format that is readable/usable
by the jury members. NOTE: You must submit/upload an electronic copy of the
publication!!
Publications must have been produced between July 1, 2013 and June 30,
2014.
Criteria for evaluation:
(a) Relevance for the SIG members;
(b) Societal or scholarly significance of the topic discussed;
(c) Creativity and originality of the content;
(d) Clarity of expression; and
(e) Presentation quality.
Please contact the chair of the jury for this award or the SIG Cabinet
chair if you have any questions:
Kathryn La Barre (SIG Cabinet Chair) klabarre at illinois.edu
Heather Pfeiffer, (Jury Chair and Deputy SIG Cabinet Director)
heather at pfeifferfamily.net/sigpublicationoftheyear.html
What is an eligible publication?
Any type of SIG Publication including newsletters, transactions,
directories, or other publications.
To be considered, a publication must be in a format that is readable/usable
by the jury members. NOTE: You must submit/upload an electronic copy of the
publication!!
Publications must have been produced between July 1, 2013 and June 30,
2014.
Criteria for evaluation:
(a) Relevance for the SIG members;
(b) Societal or scholarly significance of the topic discussed;
(c) Creativity and originality of the content;
(d) Clarity of expression; and
(e) Presentation quality.
How do I nominate a publication?
Apply now!
http://www.softconf.com/asist2/SIG_PUB/cgi-bin/scmd.cgi?scmd=basicSubmit
<http://www.softconf.com/asist2/SIG_PUB/submit.html>
Please contact the chair of the jury for this award or the SIG Cabinet
chair if you have any questions:
Kathryn La Barre (SIG Cabinet Chair) klabarre at illinois.edu
Heather Pfeiffer, (Jury Chair and Deputy SIG Cabinet Director)
heather at pfeifferfamily.net
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <
http://mail.asis.org/pipermail/asis-l/attachments/20140706/600c92fb/attachment-0001.html
>
------------------------------
Message: 3
Date: Sun, 29 Jun 2014 18:47:37 +0900
From: "Robert [Bob] Allen" <rba at boballen.info>
To: asis-l at asis.org
Subject: [Asis-l] Organization and Access of Big Data - Yonsei
Workshop July 17-18
Message-ID: <53AFE0B9.4030400 at boballen.info>
Content-Type: text/plain; charset="iso-8859-1"; Format="flowed"
*Organization and Access of Big Data*
Yonsei University BK 21 International Workshop
July 17-18, 2014
Department of Library and Information Science
<http://boballen.info/YonseiLIS.html>, Yonsei University, Seoul Korea
Invited Speakers:
?Sayeed Chowdhury <http://www.educause.edu/members/sayeed-choudhury>,
Johns Hopkins University, Baltimore, USA
oResearch Data Management
?Mike Christel <http://www.cs.cmu.edu/%7Echristel/>, Carnegie Mellon
University, Pittsburgh, USA
oImproving Access to Video Oral Histories through Informedia Technologies
oIncreasing Interest in Information Repositories through Games
?Hiddeo Joho
<http://www.slis.tsukuba.ac.jp/%7Ejoho.hideo.gb/doku.php?id=home>,
University of Tsukuba, Tsukuba, JP
oTemporalia
?James Smithies
<http://www.arts.canterbury.ac.nz/philosophy/people/smithies.shtml>,
University of Canterbury, Christchurch, NZ
oBig Data & Difficult Data: The UC CEISMIC Canterbury Earthquakes
Digital Archive
No charge.The language of the workshop is English. Please
RSVP:Registration Page <https://www.surveymonkey.com/s/X359T3H>.For more
information contact:rba at boballen.info <mailto:rba at boballen.info>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <
http://mail.asis.org/pipermail/asis-l/attachments/20140629/58fe62f2/attachment.html
>
------------------------------
Subject: Digest Footer
_______________________________________________
Asis-l mailing list
Asis-l at asis.org
http://mail.asis.org/mailman/listinfo/asis-l
------------------------------
End of Asis-l Digest, Vol 118, Issue 2
**************************************
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.asis.org/pipermail/sigifp-l/attachments/20140707/0a63a0c4/attachment-0001.html>
More information about the Sigifp-l
mailing list