Tuesday, April 11, 2017

Self and Peer Assessment not assigning any users to evaluate

We've encountered a few cases where the self and peer evaluation does not seem to give the students anyone to evaluate after they do their submission.

It's not affecting all courses.

After some insight from Blackboard about where this tool stores data, we did have a breakthrough.

It turns out this tool stores pretty much everything in the file system, not in the database.

To find it, you will need to know the COURSEID and the CONTENTPK1 related to the Self and Peer Assessment. Technically you don't need a database query to do it, just mouse over the assessment and look for the content= bit.

The Self and Peer Assessment tool will then store information in


This folder will contain sub-folders, and there are two that were important to us

  • submissions - all the student submissions go here into USERPK1_1 folders 
  • marking - where the evals are stored 

In this case, there's a very special file in marking called marking.txt that assigns evals to the individual students, e.g., if you have two evals per student, there should be one record for each student with two other students to eval.

The marking.txt file gets generated once, apparently at the Submission End Date and NOT at the Evaluation Start Date.

The problem occurs when the Submission End Date is extended after the original date has passed. The marking.txt doesn't get re-generated at the new Submission End Date.

Thus, any students who submitted during the extension period are not counted in the marking.txt, and those students will have no one to evaluate.

You can check this by looking at the date of the marking.txt, and then checking the dates on the submissions folder for that particular user pk1.  If the user has submitted after the marking.txt was created, they are out of luck.

The workaround we came up with:

1) delete the original marking\marking.txt related to the assessment

2) re-trigger the evaluation process via Course Tools > Self and Peer Assessment > assessment name > View Evaluations

This should generate a new marking.txt which should now contain all submitters to date.

IMHO, this should only be done PRIOR to Evaluation period because you are telling Bb to re-assign evaluations.  I doubt you'd want to do this after evals have started, and some have already evaluated...
Addendum: the marking.txt can get prematurely generated if the instructor loads the "View Evaluations" page at any point during the submission period. It will create the marking.txt file and populate with whomever has submitted up to that point (Thanks Tim @ UBC)

Friday, August 14, 2015

Reverse Engineering the Raw Results of a Multiple Answer Question

I had occasion recently to obtain assessment results out of a recovered database.  One question type that was a bit puzzling was the Multiple Answer where the Answers were randomized to the student.

Say I created a question:

When the student took the test, the answers were randomized, e.g.,

When I extracted the results, I got a data string like

Useful bits:
  • answer_order: 0, 3, 4, 1, 2 (the order answers were displayed to the student); note: the ordinal position is 0.
  • sequence of response_values (the actual selections)
  • score_value: 0.0 (what the student auto-scored)

Does the sequence of response_values corresponded to the original order of answers in the question, or the order of answers displayed to the student?


It is corresponds to the original order of answers in the question.


The question had five answers
  • 3 - position 0
  • 4 - position 1
  • 5 - position 2
  • 6 - position 3
  • 9 - position 4
The question was displayed to the student
  • a. 3 = position 0
  • b. 6 = position 3
  • c. 9 = position 4
  • d. 4 = position 1
  • e. 5 = position 2
That corresponds to the answer order

The student selected a. 3, b. 6, c. 9

That corresponds to the sequence

and so on.

Finally, the student received a score of 0 (in my example, they had to get all the multiple answers correct, no partial credit)

Wednesday, September 17, 2014

pushconfig without starting tomcat services

Saw this question on BBADMIN-L mailing list which had a useful tip from the community:

Does anyone know if it's possible to run a pushconfig but not start the tomcat processes? I need to do several patches that require a pushconfig but I don't want to wait for the servers to startup and shutdown.


Nick (MSJC): Sure in the pushconfigupdates.bat\sh and pushconfigupdates.bat\sh.bb files just comment out the line that calls services.start. 

Miroslav (CSU Chico): Yes. You just need to comment out the starting part out of the script. We do this regularly after each release pack upgrade. Simply edit pushconfig and comment out the part that tells it to start the app node. We also usually change the text so it says NOT STARTING at the end.
This needs to be an option when upgrading as well. We pretty much never want the system to start up immediately after upgrade finishes.

Friday, August 15, 2014

IMS LTI Launch Test

IMS LTI Launch Test

The prior IMS LTI test site I was using (see my older blog post) no longer seemed to work.

I found a new one thanks to the JISC-funded ceLTIc (http://www.celtic-project.org/)

There are two ways you can use IMS LTI in Blackboard:

  • Using Oscelot Basic LTI tool
  • Using Blackboard's IMS LTI Tool Provider

I've included both ways to add the IMS LTI tool.

I. Using Oscelot Basic LTI tool

1. Install and configure Oscelot Basic LTI 

 2. Register New Tool

  1. Go to System Administration tab
  2. then  Basic LTI tools (under the Tools section)
  3. click on Register New Tool
  4. Enter
    • Name: IMS LTI Launch Test
    • Launch URL: http://ltiapps.net/test/tp.php
    • Consumer Key: jisc.ac.uk
    • Shared Secret: secret 
  5. Submit
Should look like

After Register New Tool

3. Edit Data Settings for this new tool

  1. Select Edit data settings (pull-down) for this new toolname
  2. Enter
    • Context ID: Check
    • Value to use for Context ID: Database key (default)
    • Context sourceId: Check
    • Context Title: Check
    • User ID: Required by tool
    • Value to use for user ID: Batch UID (default)
    • SourceId: Check
    • User name: Required by tool
    • Email: Required by tool
    • Role Mappings:
      • Instructor to Instructor
      • Student to Learner
      • Teaching Assistant to Instructor (or Teaching Assistant)
  3. Submit
Should look like: 
After Data Settings

4. Edit Launch Settings for this new tool

  1. Select Edit launch settings (pull-down) for this new toolname
  2. Enter
    • Open tool in: select New window
  3. Submit
Should look like:

5. Enable the tool and configure how to display it

  1. Pulldown by toolname, choose Enable
  2. Pulldown by toolname, choose Add as course tool
  3. Checkbox the toolname, choose Display on Menu: Tools
After enabling the tool and configuring of Display on Menu

II. Using Blackboard's IMS LTI Tool Provider

Blackboard has had Basic LTI support since 9.1SP4.

1. Register Provider Domain

  1. Go to System Administration tab
  2. then Building Blocks
  3. then LTI Tool Providers
  4. Click on Register Provider Domain
  5. Enter
    • Provider domain: ltiapps.net
    • Provider Domain Status: Approved
    • Default Configuration: Set separately for each link
    • Send User Data: Send user data only over any connection (note: I'd prefer over SSL)
      • User Fields To Send
      • Role in Course: check
      • Name: check
      • Email Address: check
  6. Submit
Should look like

After Provider is Registered

3. Set up Tool Placement

  1. Click on the '0' under Placements for the row of the provider (ltiapps.net)
  2. Create Placement
  3. Enter
    • Label: IMS LTI Launch Test
    • Handle: imsltilaunchtest
    • Type: Student Tool (for simplicity)
    • Tool Provider URL: http://ltiapps.net/test/tp.php
    • Tool Provider Key: jisc.ac.uk
    • Tool Provider Secret: secret
  4. Submit
Should look like:
After Placement Created

III. Now that LTI is set up we can use it in a course

1. Add tool to your course

  1. Go into your course as an Instructor
  2. Go into a content area/folder
  3. Under Tools menu, you should see the new toolname (e.g., IMS LTI Launch Test)
  4. Select the new toolname
  5. Submit
Adding LTI (e.g., IMS LTI Launch Test)  to the Course
After LTI (e.g., IMS LTI Launch Test) added to Course

2. Test the tool (as instructor, as student)

Note: beware browser security measures, e.g., pop-up blocking, content blocking (since we're loading an insecure page)
  1. Click on the toolname link you added
    • If you are using the Oscelot Basic-LTI : It should open a new window
    • If you are using the Bb LTI Tool Provider : It should open in the lower frame (yeah, no choice to open in a new window)
  2. The http://ltiapps.net/test/tp.php should load and display various POST parameters
Oscelot Basic-LTI Launch should look like:
Bb LTI Tool Provider Launch should look like:

Friday, June 14, 2013

Content Editor and WIRIS supports LaTeX in 9.1SP12

Blackboard 9.1SP12's Content Editor comes with revised WIRIS plugin which no longer requires Java.
Here's an example where I have the LaTeX formula for the Quadratic Equation in the Content Editor.  The LaTeX formula is delineated with the "$$"

Note: currently the Content Editor > Preview does not render the equation.  So the only way to tell that the equation is correct is to submit your changes, then view the resulting item.

Tuesday, March 19, 2013

Copy/Paste when using the Content Editor with Firefox

There's a security setting in Firefox that prevents javascript-based HTML editors from accessing your clipboard.

There's a workaround using a Firefox add-on called AllowClipboard Helper https://addons.mozilla.org/en-us/firefox/addon/allowclipboard-helper/

Some documentation written by Ottawa University:


Monday, July 2, 2012

Wishlist/Enhancements to 9.1SP8 cross-listing/merge enrollments

I'm coming up with a list of enhancements we'd like to see for the current 9.1SP8 cross-listing/merge enrollments feature.  We're coming from the Bb Section Merge Tool (SMT), so some of it comes from features we've used there.

  • Allow instructors to create the merge 
  • Allow one-to-many feeds (e.g., one source site could be the child of multiple target sites) 
  • Document some migration path between the SMT and the new course merge 
  • Instructors > My Courses module should indent the child sites (and allow for expansion/collapse) or allow child sites to be hidden completely from view 

  • Tools that communicate with students (Announcements, Messages, Send Email) should be able to use Child Course membership to select audience 
  • Adaptive Release should be able to use Child Course membership 
  • Groups should be able to use Child Course membership when creating groups 
  • Grade Center / SmartViews - allow criteria Child Course ID condition "is blank" or "does not contain" (which is useful if you are merging enrollments into section 01 for instance, and want a smartview of section 01) 

Before I submit, I wanted to see if anyone else had things on their wish list...