Sakai

Apr 24 11:26

Interaction Style 2: Discussion

This data flow diagram illustrates the how students and teachers could interact in a distributed LMS to engage in a group discussion.

A discussion tool is another typical tool found in courseware. The discussion tool is used to allow a teacher to set of "forums" or "threads" of conversation related to the course material. Like the assignment tool, it also lives and dies with the course worksite.

An alternative approach would be to distribute the messages between the courseware system and a learner centered platform, much like email systems do. The difference between the a distributed leaning management system discussion and traditional email systems would be that this content would be stored in a standardized format that allowed users to easily re-use the content in their other courses or portfolios.

Again, once the course ends or the student leaves the institution, they have the option to keep a copy of all of these discussions for there own use, much like they do with email.

Again, there is a lot of duplicated data in distributed system like this which may end up causing issues for storage. However, this does allow each learner to retain a record of all of the discussions that occurred in their classes...forever if they wish to. Similarly, this frees the institution from maintaining the course indefinitely "just in case" students need access to their data.

An important assumption is that a system that can engage in this sort of messaging becomes standardized, allowing students to remix and reuse their content in multiple classes at multiple institutions.

Apr 18 18:40

Interaction Style 1: Graded/Rated Assignments

This data flow diagram illustrates the how students and teachers would interact in a distributed LMS to carry out the traditional graded assignment workflow.

A frequent use of courseware is to assign work to students, collect that work from students, assess the work and release the grades to students. In most courseware systems, this is all done in one tool. The Assignment tool (or the assignment and gradebook tools) "live" in a course. The design of courseware is mainly to facilitate the instructor's ability to manage the course.

An alternative approach would be to distribute the various transactions between two systems, the courseware system and a learner centered platform. Each set of tools would be designed and configured with the primary user's interest in mind.

The student would receive a message in their "inbox" with the assignment instructions, learning outcomes and rubric for the assignment.

The student would then do the work, saving their "drafts" in their own system and eventually sending back a response to the assignment with their work attached. Note that a copy is sent to the instructor, with the original content still on the student system.

The teacher would receive the student work in her "inbox" and (assuming that there is to be no formative feedback) evaluate the work against the rubric and releasethe grades back to all of the students.

There is a lot of duplicated data in a system like this which may end up causing issues for storage. However, this does allow each learner to retain a record of all of the assignments, work and assessment data that occurred in their classes...forever if they wish to. Similarly, this frees the institution from maintaining the course indefinitely "just in case" students need access to their data.

An important assumption is that a system that can engage in this sort of messaging becomes standardized, allowing students to remix and reuse their content in multiple classes at multiple institutions.

Mar 28 14:52

A walkthrough through portfolios in SyrCLE

Quicktime movie of a walkthrough of OSP in our local Sakai instance, SyrCLE.

I made a screencast of the OSP setup we have here in the School of Education. I wasn't able to interview a student so that I could show off their portfolio, but it really does look pretty good.

Instead, you get to see some test data... Ipsum lorem...

The file is pretty big (56MB) and it doesn't "stream" well. I used IShowU to make it and for $20, its a pretty good little app! I just wish it would create a "fast start" movie. Maybe I missed something in the setup...

Regardless, I tried to take the viewer through the following:

  • Drivers behind our pilot
  • Our plan for organizing students into cohorts
  • The types of sites we use in our instance of Sakai
  • Some documentation and a conceptual model I wrote about Portfolio Templates (on confluence).
  • Some preliminary web designs for what we wanted the portfolios to look like.
  • A description of the different data structures created to support our plan and their availability through the Community Library. (See the attachments to that page of confluence).
  • A demonstration of what evaluators get to see when they look at student portfolios published using our "Portfolio Review" Template .
  • A description of our alternative method for assessing student portfolios using the Data Point tool.
Mar 27 19:47

Workflow for coursework and portfolios

Data Flow Diagram of SyrCLE
Data Flow Diagram of SyrCLE:

Courseware and portfolio systems are usually designed as relational databases to allow a minimum of data duplication while giving users different roles and permissions to interact with their content and data. Students and faculty have expectations about how different tools should be used to organize data into familiar structures with implicit rules for interacting with the data in those tools. The design of these tools have not not allowed a lot of interplay between the tools. It is difficult to publish a portfolio that reuses classroom content (ie: assignments and discussion threads) that the student otherwise has access to view and manipulate in the limited manner the tool allows.

Furthermore, if a student enrolls in another institution or another class that doesn't use the same instance of the courseware, the data from the different classes can not be combined to create new content.

What is needed is a student centered content management system that serves as the student's virtual backpack and their main platform for lifelong learning. The interface between their content management system and the classroom management tools deployed in a LMS has not yet been designed.

This data flow diagram is intended to describe the flow of information into, out of and within a distributed, networked LMS that has two main components: course content and student content management tools.

A couple days ago I shared some "reconceptualizing" Sakai and OSP based on some feedback from a couple of our faculty and the problems that Dr. Joseph Shedd (our PI) has shared in our meetings between Weber/UMich/Portland/Virginia Tech.

Feb 24 09:35

Rating Scales for Goal Aware tools

Our faculty have settled into a 1-4 rating scale for EVERYTHING that we do in the School of Education, regardless of the activity or the standard being measured in our assessment system of Goal Aware tools and OSP.

Feb 06 22:14

Goal Aware Profile

How do students come to understand how well they are doing in a program?  Certainly, they can look at their grades in their courses and see their GPA. Within a specific class, they know what their grade for each assignment.
Jan 18 16:39

LSB History - Part 6

 The following is a segment of a larger story that I wrote to attempt to summarize the history of the Living SchoolBook, a research group in the School of Education at Syracuse University.  In this entry I begin to talk a bit about our involvement in the Sakai network and our contribution to that group.  If you haven't read any of the previous articles about the history of the LSB, you may want to look at the previous entries related to this topic.

Jan 18 10:20

LSB History - Part 5

 The following is a segment of a larger story that I wrote to attempt to summarize the history of the Living SchoolBook, a research group in the School of Education at Syracuse University.  In this entry I begin to talk a bit about our involvement in the Sakai network and our contribution to that group.  If you haven't read any of the previous articles about the history of the LSB, you may want to look at the previous entries related to this topic.

Dec 09 08:51

Teaching, Assessment and Responsive Pedagogy

It was late at night at the Atlanta Sakai conference and I was thinking a little more about making pithy statements about the practice of teaching.  At the tech demo table for Goal Aware tools I was asked whether I thought that faculty would be resistant to using Goal Aware tools to markup their assignments with the learning outcomes that they are supposed to be addressing and then thoughtfully rate students' performance towards learning outcomes.  I am not qualified to answer (I am not a teacher) but that won't stop me from thinking a little about it...I'll even think out loud.  It helps ground me in the rationale for the Goal Aware tools idea.

The movement toward standardization of learning outcomes in general is met with resistance.  Whenever an outside agency steps in to regulate or inspect or make change in an existing system, those vested in that system are going to resist.  The accrediting body for the School of Education doesn't force the schools that it inspects to adopt their standards, however.  NCATE requires that the school articulate their own expectations of students.  While not at all a trivial task, this makes the pill easier to swallow (doesn't it?).  Even though the consensus building effort is extremely laborious (or so I have heard), I know that during the process faculty know that this is probably good medicine.When that consensus building process finishes its first iteration, I think you can hear the sigh of relief in surrounding hills and towns.  There is real sense of accomplishment.  

They don't say, "Hooray! Now we can get to work measuring student progress toward our outcomes; finding ways to improve our classes; adjusting our programs and our curriculum.  After that maybe we can set new goals and outcomes for round two!"

Nope, you won't get a sigh of relief about that.  This is endless work.  Iterative and continuous work that conscientious teachers and administrators have to struggle with.  The time and energy to generate good assessment data that can be relied upon to draw conclusions about the program and the classes will take away from the time spent doing other things such as research, planning new lessons and talking to students.  To the less insightful it may seem counterproductive.  Plenty of arguements can (and have) been made against it.

Dec 06 17:37

Blackboard BOF

When we presented our original Goal Aware ideas at the Baltimore Sakai Conference, I spoke with Deborah Everhart in the halls after our presentation.  She told me that Blackboard was working on requirements for a similar system.  I had followed up with Deb on the phone after the conference.  She had someone in their product development group call me at Syracuse.  I described our ideas to her and we really weren't sure how to proceed.  At that time, I felt that the intellectual property issues around the idea was an impediment to collaboration.

While our Goal Aware installation of Sakai in the School of Education is our center for innovation in pedagogy and technology to support that, our enterprise courseware installation is Blackboard.  It would be great if "Goal Awareness" could be baked into that installation.  It would be even better if Blackboard could facilitate that.