Portfolio-Remix Performance Intervention

Online Publishing with Movable Type 5.10

Jeanette Novakovich Professional Writing Minor Program English Department Concordia University Montreal, Quebec

PERFORMANCE INTERVENTION

2012 Novakovich

PERFORMANCE INTERVENTION

TABLE OF CONTENTS
Edition Notice Twitter Microblogging Session for Portfolio-Remix Setup Instructions Microblogging Instructions Microblogging Instructions (student handout) Managing the post-activity debriefing APPLICATION NAME - Step-by-Step Quick Guide for Publishing an Entry Step-by-Step Quick Guide for Publishing an Entry Finding Creative Commons Licensed Images Guidelines for Publishing an Entry Online Survey Checklist for Publishing an Entry Appendix 1: Evaluations Sample Satisfaction Survey (Kirkpatrick Level 1) Sample Criterion-Referenced Assessment (Kirkpatrick Level 2) Sample of a Level Three Evaluation (Kirkpatrick Level 3) Sample of a Level Three Evaluation (Kirkpatrick Level 3) Appendix Two: Formative Evaluations Technical review Draft Email #1 Draft email #2 Draft email #3 Draft #4 2012 Novakovich 38 39 40 41 43 44 3 19 21 24 27 29 30 31 32 33 35 5 6 9 10 13 14

PERFORMANCE INTERVENTION

Blank feedback form Hypothetical Pilot test Revision of interventions based on pilot test Editorial review Draft #1 Draft #2 Draft #3 Performance Intervention Stylesheet References 52 45 46 47 48 48 49 50 51

2012 Novakovich

PERFORMANCE INTERVENTION

EDITION NOTICE

Crap Prevention: Troubleshooting Movable Type 5.10 Professional Writing Minor Program English Department Concordia University Montreal, QC

First Version Copyright 2012 Jeanette Novakovich. All rights reserved.

2012 Novakovich

PERFORMANCE INTERVENTION

TWITTER MICROBLOGGING SESSION FOR PORTFOLIO-REMIX

Overview of the activity The purpose of this intervention, a weekly microblogging session, is to provide learners with a support and recognition feedback system. Background of the activity More and more employers are asking applicants if they have a website or other web presence that they can access easily. For employers who want to see beyond the traditional one-page rsum, students can develop a rich alternative in the form of an eportfolio, which is an online digital form of the traditional paper-based portfolio. For this reason, an e-portfolio hub, which is a website that aggregates or pools student portfolios together in one common location, was established for students enrolled in the program. Essential to the success of the program is ensuring that students maintain high online publishing standards as defined by the Professional Writing Minor Program when using Movable Type 5.10 software, an online open source publishing Content Management System, to design and publish professional e-portfolios. The primary goal is to ensure that students comply with online publishing standards set by the program by providing a support and recognition system in the form of a community microblogging session.

Summary of the activity Learners will read published entries on the blog feed of Portfolio Remix and provide feedback and support in the form of Twitter tweets that include the following hashtag, #portfolio-remix, a keyword that allows Twitter search engines to create a customized search feed. Tweets will consist of constructive advice, alerts for publishing mishaps, and congratulatory notes. Learners can then respond to the tweets as they are fed into a Twitter search feed on the Portfolio-Remix online support website. Main objectives Select [Convert Line Breaks] format 100% of the time

2012 Novakovich

PERFORMANCE INTERVENTION

Place images appropriately on the page, centered, at the top of entry in [Body] field set at 500 pixel width in order to fit the container space or size of entry field 100% of the time and provide consistency of expression Attribute all outside sources 100% of the time Publish entry summaries or introductions in the [Body] field 100% of the time Publish the bulk of entry in the [Extended] field 100% of the time

Format of the activity During a thirty-minute microblogging group session, learners will tweet microblogs or messages that consist of 140 characters or less that include the #portfolio-remix hashtag. Expectations Expect Expect Expect Expect that learners have tweeters to be informal and polite nonjudgmental alerts a measure of recognition a measure of fun

Prerequisites of the activity: When the activity takes place students should have basic working knowledge of online of online publishing and social media, particularly, microblogging. As experienced micro bloggers, learners will know how to get started and what to do for the most part. Time: The 30-minute formative evaluation activity is divided into two parts, including a brief PowerPoint presentation and a hands-on learning activity, followed up by a debriefing. Equipment and Services: PC lab Projector Access to Internet Material and Props: Power Point embedded on course website Printed instructors guide Printed student guide Online activity Online assessment Schedule: 2012 Novakovich 7

PERFORMANCE INTERVENTION

5:45 Classroom setup 6:00 Introduction and explanation of activity 6:10 Formative evaluation activity 6:30 Bio break and snacks (informal Q&A) 6:45 Online satisfaction survey

2012 Novakovich

PERFORMANCE INTERVENTION

SETUP INSTRUCTIONS
Classroom: Training for the microblogging session will take place in Hall 923 during regularly scheduled class time. Materials: Activity guides for the students and instructor will be printed prior to the training session. Printed Instructors Guide Printed Learners Guide Before the students arrive: 1. Turn on the projector by pushing the red button under the projector. 2. Login to the main computer located at the front of class: a. Username: jnovako b. Password: ******** 3. Type Portfolio-Remix.com into the address bar. 4. Open printed instructors guide. After the students arrive at 6:00 p.m.: 1. Have students complete the following tasks: 1.1. Login to computer terminals. 1.2. Type Portfolio-Remix in the address bar. 2. Pass out learner handout for microblogging session. You are now ready to begin the training program. Administrivia: Your focus will be on explaining the purpose of the activity and the learning objectives, and enforcing the coding of the tweets that you want them to generate while encouraging learners to maintain a friendly and supportive tone. Read through the handout before the learners begin the activity.

2012 Novakovich

PERFORMANCE INTERVENTION

10

MICROBLOGGING INSTRUCTIONS
1. Go to Portfolio-Remix main website: http://www.portfolio-remix.com Administrivia: Common classroom activity. Problems are not anticipated. 2. Select the [Blogs] tab on the navigation bar. Administrivia: Common classroom activity. Problems are not anticipated. 3. Read through the entries presented in the blog feed. Administrivia: Common classroom activity. Problems are not anticipated. 4. Respond to at least ten entries by tweeting information that evaluates the entry in terms of excellence and adhering to publishing standards. See Tweet guidelines below. Administrivia: Common activity. Problems are not anticipated. Every entry page will have Share Us buttons, which include a Twitter icon. When students select the Twitter icon, a popup box will open with a link to the entry and its title. Students can then add a brief personal message. Remind them to include the #portfolioremix hashtag. This way the Tweet will enter the Twitter Feed embedded on the Portfolio-Remix online support help website. 5. After responding to an entry, read through the Twitter feed on the PortfolioRemix online support website and respond to Twitter feedback: http://www.portfolio-remix.com/twitter-feed.html. Administrivia: Explain to the students that they will now read through the Twitter Feed and respond to tweets of their work and their colleagues, following the guidelines below. Responding to a professional entry If an entry is excellent, encourage your Twitter followers to read the entry: Tweet#portfolio-remix BRAVO! + add positive word or two (Twitter will add a link to the entry and title to all tweets made from the entry page.) 2012 Novakovich 10

PERFORMANCE INTERVENTION

11

Administrivia: Common activity. Problems are not anticipated. If a student enjoys reading an entry, Tweet it out positively. The student can then Tweet out any format issues in subsequent Tweets. Students are not limited to one Tweet per entry.

Responding to text formatting If the author forgot to use [Convert Line Breaks] ): Tweet#portfolio-remix CLB!!! + add positive word or two Administrivia: Help students identify entries that have a Word document pasted into the [Rich Text Editor] format. This can be achieved by observing the blog feed on the home page. Entries with [Rich Text] will show script or coding, irregular font styles. If the author has a weak introduction: Tweet--#portfolio-remix INTRO? + add positive word or two Administrivia: Challenge students to be critical and supportive. Advise them in the introductory paragraph does not compel them to read further, click the Continue reading link, to help the author by letting them know in a friendly and supportive manner. If the entry does not have a Continue reading link: Tweet--#portfolio-remix Extended? + add positive word or two Administrivia: Show students that they can identify that an [Extended] entry field is empty if the blog feed is long and if the following link is not present: Continue reading Responding to images If the author forgot to include an image: Tweet#portfolio-remix Image? + add positive word or two Administrivia: No problems anticipated. If the author failed to provide attribution for any images: Tweet#portfolio-remix Attribute? + add positive word or two

2012 Novakovich

11

PERFORMANCE INTERVENTION

12

Administrivia: No problems anticipated. If the author has off-size or off-center image: Tweet#portfolio-remix Image center? + add positive word or two Administrivia: No problems anticipated. Responding to tweets If a tweet is positive: [Reply] and tweet a warm thank you. If a tweet is constructive: [Reply] and tweet a warm thank you. If a tweet is positive and funny: Retweet. Administrivia: No problems anticipated. Demonstrating the activity Demonstrate the activity by asking the students to identify an entry that they think is polished and professional. Open the entry by clicking on the link in the blog feed to the entrys page. Demonstrate the positive Bravo! tweet. Next, ask the students if they have any questions. And finally, ask the students to continue the activity on their own and offer to assist any students who are experiencing technical difficulties.

2012 Novakovich

12

PERFORMANCE INTERVENTION

13

MICROBLOGGING INSTRUCTIONS (STUDENT HANDOUT)

1. 2. 3. 4. 5. Go to Portfolio-Remix main website: http://www.portfolio-remix.com Select [Blogs] tab on the navigation bar. Read through the entries presented in the blog feed. Respond to at least ten entries. After responding to an entry, read through the Twitter feed on the Portfolio-Remix online support website and respond to Twitter feedback.

Responding to a professional entry If an entry is excellent, encourage your Twitter followers to read the entry: Tweet#portfolio-remix BRAVO! + add positive word or two (Twitter will add a link to the entry and title to all tweets made from the entry page.) Responding to text formatting If the author forgot to use [Convert Line Breaks] ): Tweet#portfolio-remix CLB!!! + add positive word or two If the author has a weak introduction: Tweet--#portfolio-remix Intro? + add positive word or two If the entry does not include a Continue reading link: Tweet--#portfolio-remix Extended? + add positive word or two Responding to images If the author forgot to include an image: Tweet#portfolio-remix Image? + add positive word or If the author failed to provide attribution for any images: Tweet#portfolio-remix Attribute? + add positive word or If the author has off-size or off-center image: Tweet#portfolio-remix Image Center? + add positive word or two Responding to tweets If a tweet is positive: [Reply] and tweet a warm thank you. If a tweet is constructive: [Reply] and tweet a warm thank you. If a tweet is positive and funny: Retweet.

2012 Novakovich

13

PERFORMANCE INTERVENTION

14

MANAGING THE POST-ACTIVITY DEBRIEFING

1. Review the results with the learners:

2. Ask learners about what they didwhat were the results, what they enjoyed about the activity, what they disliked about the activity, and where they went right and 2012 Novakovich 14

PERFORMANCE INTERVENTION

15

where they went wrong.

2012 Novakovich

15

PERFORMANCE INTERVENTION

16

Screen

1 of 5

APPLICATION NAME Twitter Microblogging Feed File OPTION OPTION OPTION OPTION Window Help Option Netsite Objective(s) to be covered in this topic: This twitter feed will provide support and feedback for online publishing. Performance objectives that will be addressed: Select [Convert Line Breaks] format 100% of the time Place images appropriately on the page, centered, at the top of entry in [Body] field set at 500 pixel width in order to fit the container space or size of entry field 100% of the time and provide consistency of expression Attribute all outside sources 100% of the time Publish entry summaries or introductions in the [Body] field 100% of the time Publish the bulk of entry in the [Extended] field 100% of the time Option Option Option Option Option Option Option

Objectives will be presented in a Twitter feed during microblogging sessions. In addition, students can seek support anytime by tweeting for help and using the #portfolio-remix hashtag.

STATUS BAR STATUS BAR Production Instructions: Choose the <A> button on the toolbar and paste the following HTML code onto a new page of the online help support website, tag @topnav, and publish the page.

2012 Novakovich

16

PERFORMANCE INTERVENTION

17

Twitter feed code for #Portfolio-Remix <script charset="utf-8" src="http://widgets.twimg.com/j/2/widget.js"></script> <script> new TWTR.Widget({ version: 2, type: 'search', search: '#portfolio-remix OR portfolio-remix', interval: 30000, title: 'Portfolio-Remix', subject: ' ', width: 500, height: 800, theme: { shell: { background: '#f9fae8', color: '#a1092f' }, tweets: { background: '#ffffff', color: '#444444', links: '#7d0628' } }, features: { scrollbar: true, loop: true, live: true, behavior: 'default' } }).render().start(); </script>

2012 Novakovich

17

PERFORMANCE INTERVENTION

18

The published page will have the following appearance:

2012 Novakovich

18

PERFORMANCE INTERVENTION

19

Screen

__2_ of _5___

APPLICATION NAME - STEP-BY-STEP QUICK GUIDE FOR PUBLISHING AN ENTRY

File OPTION OPTION OPTION OPTION Window Help Option Netsite Option Option Option Option Option Option Option

Performance objective(s) (competencies) it addresses

Select [Convert Line Breaks] format 100% of the time Include an appealing Creative Commons licensed image 100% of the time Place images appropriately on the page, centered, at the top of entry in [Body] field set at 500 pixel width in order to fit the container space or size of entry field 100% of the time and provide consistency of expression Attribute all outside sources 100% of the time Publish entry summaries or introductions in the [Body] field 100% of the time Publish the bulk of entry in the [Extended] field 100% of the time Provide search engine optimization 100% of the time

The objectives will be presented in the form of a quick procedural step-by-step guide to online publishing.

STATUS BAR STATUS BAR 2012 Novakovich 19

PERFORMANCE INTERVENTION

20

Production Instructions: Screenshots of steps will be provided.

2012 Novakovich

20

PERFORMANCE INTERVENTION

21

STEP-BY-STEP QUICK GUIDE FOR PUBLISHING AN ENTRY

The following instruction set provides you with the steps you need to in order to publish an entry according to the guidelines established by the Professional Writing Minor Program at Concordia University. Before beginning this procedure, you should have an entry composed in a Word document, and you should have an image downloaded into your personal computer for uploading a Creative Commons licensed image with a pixel resolution of 500 pixel width or greater. The overall procedure should take no more than 10 to 15 minutes. 1. Creating a new entry 1.1. Log into dashboard. 1.2. In the sidebar, select [Entries] > [New] 1.3. In the top entry field, type your title. 1.4. Select a Format: [Convert Line Breaks]. 2. Uploading an image 2.1. Select Image Icon from the toolbar. 2.2. On the popup screen, select [Upload a new image from computer]. 2.3. Select the image you prepared for your entry. 2.4. On the next popup screen, set pixel width to 500 pixels. 2.5. Select [Center]. 2.6. Select [Finish]. 2.7. Provide attribution for your entry by linking caption to source. 3. Adding the text 3.1. Copy and paste the first paragraph of your entry. 3.2. Select [Extended] entry field. 3.3. Copy and paste the remainder of the entry. 3.4. Switch format back to [Rich Text Editor]. 4. Optimizing SEO 4.1. Select from the available links offered by Zemanta. 4.2. Select from the available tags offered by Zemanta. 5. Publishing an entry 5.1. Select [Preview]. 2012 Novakovich

21

PERFORMANCE INTERVENTION

22

5.2. Select [Publish entry]. 6. Socially bookmarking your entry 6.1. Select [View Entry]. 6.2. Select a [Twitter icon] or [Facebook icon]. 6.3. Tweet (add #portfolio-remix and/or post to Facebook.

2012 Novakovich

22

PERFORMANCE INTERVENTION

23

Screen

__3_ of __5__

APPLICATION NAME - Finding Creative Commons Licensed Images

File OPTION OPTION OPTION OPTION Window Help Option Netsite Performance Objective: Include an appealing Creative Commons licensed image 100% of the time How the objective(s) will be presented (either a sketch or a narrative) The objective will be presented in a descriptive bullet list of resources. As well, the Creative Commons license will be defined and illustrated. Option Option Option Option Option Option Option

STATUS BAR STATUS BAR Production Instructions: describe any graphics, photos, and audio, animation, and video sequences needed on this display: Screenshots of the Creative Commons license will be provided and a Creative Commons licensed image will provide a visual argument.

2012 Novakovich

23

PERFORMANCE INTERVENTION

24

FINDING CREATIVE COMMONS LICENSED IMAGES

A Creative Commons license allows the maker of an image to retain the copyright of their work and, at the same time, gives permission for others to reuse the work. The license provides the original artist a number of conditions to select from that the user must abide:

"You let others copy, distribute, display, and perform your copyrighted work and derivative works based upon it but only if they give credit the way you request (CC Org). "You allow others to distribute derivative works only under a license identical to the license that governs your work (CC Org). "You let others copy, distribute, display, and perform your work and derivative works based upon it but for noncommercial purposes only (CC Org). "You let others copy, distribute, display, and perform only verbatim copies of your work, not derivative works based upon it (CC Org). The following websites provide a number of Creative Commons licensed images or search engines to help you locate images that are available for reuse:
Google Image advanced search- This search engine allows you to search for images that are licensed for reuse. Image Links from Creative Commons This website provides numerous links to the Creative Commons licensed databases of images. Flickr Advanced Search This photo sharing website allows you to select a search for Creative Commons licensed images and videos. Wikimedia Commons This website provides a number of public domain images.

2012 Novakovich

24

PERFORMANCE INTERVENTION

25

NASA Image Archive - NASA has a number of non-copyrighted government images related to space flight, astronomy, and aeronautics. US Government This link will lead you to public domain photos and images created by the United States government. Open Clip Art- This website provides an archive of free-to-use clipart.

When you locate an image that you would like to use on your portfolio, check the license to find out how to attribute the image and how you are allowed to use the image, whether it can be a derivative work or a verbatim copy of the work.

2012 Novakovich

25

PERFORMANCE INTERVENTION

26

Screen

__4_ of __5__

APPLICATION NAME - Guidelines for Publishing an Entry

File OPTION OPTION OPTION OPTION Window Help Option Netsite Option Option Option Option Option Option Option

Objective(s) to be covered in this topic: Select [Convert Line Breaks] format 100% of the time Include an appealing Creative Commons licensed image 100% of the time Place images appropriately on the page, centered, at the top of entry in [Body] field set at 500 pixel width in order to fit the container space or size of entry field 100% of the time and provide consistency of expression Attribute all outside sources 100% of the time Publish entry summaries or introductions in the [Body] field 100% of the time Publish the bulk of entry in the [Extended] field 100% of the time Provide search engine optimization 100% of the time

How the objective(s) will be presented (either a sketch or a narrative) Guidelines will be presented in a descriptive bullet list.

STATUS BAR STATUS BAR Production Instructions: None at this time. Suggestions?

2012 Novakovich

26

PERFORMANCE INTERVENTION

27

GUIDELINES FOR PUBLISHING AN ENTRY

Maintaining a high level of professionalism is key to the success of the Professional Writing Minor Programs implementation of our electronic portfolio website hub. To ensure that you are maintaining consistent and professional publishing standards, the following guidelines are provided: Use [Convert Line Breaks] when pasting any text from a Word document. Include an image at the head of every entry to contribute to an attractive entry feed to the main portfolio website. The image should have high pixel resolution (at least 500 pixel width); and when you upload the image, it should be centered and the width should be set to 500-pixel width to prevent gutter bleed. Only one paragraph of text should be pasted into the [Body] of the entry. This introductory paragraph should be polished and appealing. The rest of your entry should be pasted into the [Extended] entry field. Here, you can also add an assortment of images and videos. Avoid adding videos to the [Body] entry field; videos will slow down the blog feed significantly. After entering the text, use [Rich Text Editor] to activate the Zemanta plugin. This will give you an opportunity to create links to outside sources and add tags to your entry, thereby, creating search engine optimization. Once you have published your entry, view it and socially bookmark the entry to increase web traffic.

If you follow these guidelines, both your portfolio and the main hub will present a professional and consistent image, which will greatly enhance the credibility of both the writer and the program. Thank you very much for adhering to the guidelines.

2012 Novakovich

27

PERFORMANCE INTERVENTION

28

Screen

_5__ of ___5_

APPLICATION NAME - Online Survey Checklist for Publishing an Entry

File OPTION OPTION OPTION OPTION Window Help Option Netsite Objective(s) to be covered in this topic: Select [Convert Line Breaks] format 100% of the time Include an appealing Creative Commons licensed image 100% of the time Place images appropriately on the page, centered, at the top of entry in [Body] field set at 500 pixel width in order to fit the container space or size of entry field 100% of the time and provide consistency of expression Attribute all outside sources 100% of the time Publish entry summaries or introductions in the [Body] field 100% of the time Publish the bulk of entry in the [Extended] field 100% of the time Provide search engine optimization 100% of the time Option Option Option Option Option Option Option

How the objective(s) will be presented (either a sketch or a narrative) This intervention will take the form of an embedded online survey.

STATUS BAR STATUS BAR Production Instructions: Poll Daddy survey maker.

2012 Novakovich

28

PERFORMANCE INTERVENTION

29

ONLINE SURVEY CHECKLIST FOR PUBLISHING AN ENTRY

1. Did you select [Convert Line Breaks] Yes or No 2. Did you add an image? Yes or No

3. Was your image centered and set to 500-pixel width? Yes or No 4. Did you provide attribution? Yes or No

5. Did you paste the first paragraph of the entry into the [Body] field? Yes or No 6. Did you paste the remainder of the entry into the [Extended] entry field? Yes or No 7. Did you switch back to [Rich Text Editor]? Yes or No 8. Did you select [Links] and [Tags] to optimize SEO? Yes or No 9. Did you socially bookmark your published entry? Yes or No

2012 Novakovich

29

PERFORMANCE INTERVENTION

30

APPENDIX A: EVALUATIONS

2012 Novakovich

30

PERFORMANCE INTERVENTION

31

SAMPLE SATISFACTION SURVEY (KIRKPATRICK LEVEL 1)

(Adapted from Carliner, 2003) Please provide feedback to the following questions: 1. How would you rate this activity on a scale of 1 - 5 with 5 being the highest rating? 1 2 3 4 5

2. How much did you know about online publishing software before doing this training course? Nothing Very little Little Some Somewhat

3. How much do you know after completing the program? Nothing Very little Little Some Somewhat

4. How likely are you to use the skills taught in this program on your own outside of class without supervision? Nothing Very little Little Some Somewhat

5. What was the most valuable part of this program in terms of skill sets taught? _____________________________________________________________________ 6. What was the most effective part of this program? _____________________________________________________________________ 7. What is one aspect of the training that could improve this program most? _____________________________________________________________________

2012 Novakovich

31

PERFORMANCE INTERVENTION

32

SAMPLE CRITERION-REFERENCED ASSESSMENT (KIRKPATRICK LEVEL 2)

Performers will be evaluated through observation. The course instructor of English 396 will ask a representative sample of students that include novice, average and expert performers to create a new entry. The instructor will record observations in a chart. Main Task: Within a span of 30 minutes, create a new entry for your portfolio. Observer will circle if the behavior is present. Composes on word (not necessary but common) Opens dashboard Creates new entry Composes a title for entry Selects [convert line breaks] format Finds a creative commons image Uploads image first, 500 px, centered [body] Provides attribution Locates 1st paragraph of text in [body] field Locates remainder of text in [extended] field Selects suggested links Selects suggested tags Saves entry Refreshes website Score /130 Present Present Present Present Present Present Present Present Present Present Present Present Present Present

2012 Novakovich

32

PERFORMANCE INTERVENTION

33

SAMPLE OF A LEVEL THREE EVALUATION (KIRKPATRICK LEVEL 3)

Twelve weeks after training, in order to evaluate whether performers are publishing entries according to the programs standards, 10 direct observations of the most recent web entries will be evaluated. Google analytics will also be used to gather web metric data on published entries. Entry #1 Selected [convert line breaks] format Used a creative commons image Image 500 px, centered, [body] field Provided attribution Included no more than 1 paragraph in [body] field Located bulk of entry in [extended] field Provided links Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #2 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #3 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #4 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #5 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #6 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #7 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entr y #8 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entr y #9 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entr y #10 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No 33

Provided tagssearch terms (found in tag cloud)

2012 Novakovich

PERFORMANCE INTERVENTION

34

Score Yes = 10 pts No = 0 pts /90 Google analytics will also be used to collect web metrics, which measure the success of individual web entries, in terms of readership, to identify entries that are tagged and linked effectively. Top ten entries over the last month Title of entry #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 Number of visitors Engagement (average # of seconds spent on page or entry)

2012 Novakovich

34

PERFORMANCE INTERVENTION

35

SAMPLE OF A LEVEL THREE EVALUATION (KIRKPATRICK LEVEL 3)

After a twenty-four week period, a brief survey will be given to students to check for their understanding of the publishing procedure six months done the line. After this, a repeat of observations can be taken of the most recent published entries. Finally, Google Analytics will be used to gather web-publishing metrics. Student survey of students understanding of the publishing procedure: Provide an effective title Select [convert line breaks] format Circle Yes or Circle Yes or Circle Yes or Circle Yes or Circle Yes or Circle Yes or Circle Yes or Circle Yes or Circle Yes or No No No No No No No No No

Use creative commons licensed image Size and center images at 500 px Provide attribution or cite your sources Locate 1st paragraph of text in [body] field Locate remainder of text in [extended] field Select suggested links Select suggested tags Score /90

2012 Novakovich

35

PERFORMANCE INTERVENTION

36

In order to evaluate whether performers are publishing entries according to the programs standards, ten direct observations of the most recent web entries will be evaluated. Entry #1 Selected [convert line breaks] format Used a creative commons image Image 500 px, centered, [body] field Provided attribution Included no more than 1 paragraph in [body] field Located bulk of entry in [extended] field Provided links Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #2 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #3 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #4 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #5 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #6 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entry #7 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entr y #8 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entr y #9 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Entr y #10 Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No Yes or No

Provided tagssearch terms (found in tag cloud) Score Yes = 10 pts No = 0 pts /90

2012 Novakovich

36

PERFORMANCE INTERVENTION

37

Google analytics will also be used to collect web metrics, which measure the success of individual web entries, in terms of readership, to identify entries that are tagged and linked effectively. Top ten entries over the last month Title of entry Number of visitors #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 References Carliner S. (2003) Training Design Basics. Baltimore, MD: ASTD press. Gilbert Model (1996) adapted by Stolovitch, Harold D. & Keeps, Erica J. (2004) Training Aint Performance. Baltimore, Md: ASTD press.

Engagement (average # of seconds spent on page or entry)

2012 Novakovich

37

PERFORMANCE INTERVENTION

38

APPENDIX B: FORMATIVE EVALUATIONS

A formative evaluation plan for Performance Intervention: Online Publishing with Movable Type 5.10 will take place in a series of stages to determine the effectiveness of the course in terms of its being accurate, understandable, and functional as described by Carliner (2003): Technical review Pilot test Editorial review

2012 Novakovich

38

PERFORMANCE INTERVENTION

39

TECHNICAL REVIEW
Technical Review Participants: EL Instructional design expert with a specialization implementing Movable Type MK Movable Type expert SK Educational technology expert at the university level Procedure: Date First Contact Affirm participation Reminder Delivery September 17, 2012 September 24, 2012 November 17, 2012 November 28, 2012 Action Email Email Email Email with attachment Draft 1: Instructional materials, learners handout and storyboards for web entries Materials

Return date

November 29, 2012

Email with attachment

2012 Novakovich

39

PERFORMANCE INTERVENTION

40

DRAFT EMAIL #1 To: EL, MK, or BK From: Jeanette Novakovich Date: 17 September 2012 Subject: Portfolio-Remix Performance Intervention Hello, [Congratulations on your recent nuptials. I hope that you had an enjoyable honeymoon. I would like to thank you again for the work that you managed to complete for me during your exciting summer.] (Vary with recipient) This winter, I am completing a performance intervention for students using Movable Type software. I am writing to request a review of the performance intervention materials for the program. Coming from one of the few Movable Type experts, your feedback will provide an invaluable insight into the accuracy of the project. The review will take two forms: An evaluation of the effectiveness and accuracy of the technical content A walk-through of the training material The review materials will be sent out electronically in eight weeks, during the first week of November 2012. The review shouldnt take more than a few hours to complete. The scheduled review will take place between the following dates: November 28- Reviewer receives review materials electronically November 29- Reviewer returns reviews electronically Thank you for your consideration. Kindest regards, Jeanette Novakovich Assistant Professor, English Department Concordia University, Montreal QC
2012 Novakovich 40

PERFORMANCE INTERVENTION

41

DRAFT EMAIL #2 To: EL, MK, BK From: Jeanette Novakovich Date: 24 September 2012 Subject: Performance Intervention for Online Publishing with Movable Type 5.10 Hello, Thank you for agreeing to review the performance intervention materials that I am developing for the Professional Writing Minor Program at Concordia University. As one of the few Movable Type experts, your willingness to provide detailed feedback is truly appreciated. The review will take the form of an evaluation of the effectiveness of the content in terms of its accuracy, understandability, and the functionality of the materials. A feedback form will be provided. The review materials will be sent out electronically in six weeks, during the last week of November 2012. The review shouldnt take more than a few hours to complete. Please review the schedule: November 28- Reviewer receives review materials electronically November 29- Reviewer returns feedback electronically Please find attached an I-Tunes gift certificate as a gesture of goodwill and appreciation for your anticipated timely feedback. Kind regards, Jeanette Novakovich Assistant Professor, English Department Concordia University, Montreal QC
2012 Novakovich 41

PERFORMANCE INTERVENTION

42

2012 Novakovich

42

PERFORMANCE INTERVENTION

43

DRAFT EMAIL #3 To: EL, MK, BK From: Jeanette Novakovich Date: 17 November 2012 Subject: Portfolio-Remix Performance Intervention Hello, Thank you for agreeing to review the performance intervention materials for our program here at Concordia. The review materials will be sent out electronically in five days, during the first week of November 2012: November 4- Reviewer receives review materials electronically November 6- Reviewer returns feedback electronically I look forward to receiving your feedback. Kindest regards, Jeanette Novakovich Assistant Professor, English Department Concordia University, Montreal QC

2012 Novakovich

43

PERFORMANCE INTERVENTION

44

DRAFT #4 To: EL, MK, BK From: Jeanette Novakovich Date: 28 November 2012 Subject: Portfolio-Remix Performance Intervention Hello, Thank you for agreeing to review the performance intervention materials for our online publishing program. Please find the following items attached for the technical review: Instructors Manual Learners Handout Storyboards for web entries The overall objective of this review is to note any inaccuracies of content in terms of correctness, currency and completeness. In addition, the material can be reviews for accessibility issues for learners. The learners can be assumed to have no more than basic training using Movable Type software. And finally, please note any aspects of the materials that are not currently functional. Please feel free to make comments and corrections on the electronic drafts and be sure to complete the feedback form. I look forward to receiving your feedback on Tuesday, November 29th. Kindest regards, Jeanette Novakovich Assistant Professor, English Department Concordia University, Montreal QC

2012 Novakovich

44

PERFORMANCE INTERVENTION

45

BLANK FEEDBACK FORM

In addition to making comments directly on course material, please complete the following feedback form. Storyboards for Instructors manual Learners Material web entries, note When providing When providing slide #. feedback, note feedback, note section and page section and page #. #. Information complete? If not, note missing information. Is the information Accurate? Note inaccuracies. Is information current? Note missing updates. Is Information Understandable to a lay audience? Note any issues or confusion. Is information functional? Note any places where the material did not link or operate according to basic web standards. Any additional comments.

2012 Novakovich

45

PERFORMANCE INTERVENTION

46

HYPOTHETICAL PILOT TEST To: English 395 Technical Writing Students From: Jeanette Novakovich Date: 1 December 2012 Subject: Pilot test for Portfolio-Remix Performance Intervention Hello, As mentioned in class earlier today, you are invited to pilot a test of PortfolioRemix Performance Intervention Tuesday December 6, 2012. The test will take place at the start of class in Hall Room 923. Students who participate are eligible to take part in an I-Tunes gift card drawing at the close of the pilot test. I look forward to receiving your invaluable feedback. See you in class next week! Kindest regards, Jeanette Novakovich Assistant Professor, English Department Concordia University, Montreal QC

2012 Novakovich

46

PERFORMANCE INTERVENTION

47

REVISION OF INTERVENTIONS BASED ON PILOT TEST Category A: Showstopper Category B: Must change Category C: Nice to change

2012 Novakovich

47

PERFORMANCE INTERVENTION

48

EDITORIAL REVIEW DRAFT #1 To: <editorial reviewer> From: Jeanette Novakovich Date: 1 October 2012 Subject: Editorial review for Portfolio-Remix Performance Intervention Hello, Congratulations on your recent and well-deserved promotion. As we discussed last week, I am writing to formally request an editorial review of the training materials for Portfolio-Remix Performance Intervention. I appreciate your having expressed your willingness to participate in the final review process. The review materials and style sheet will be sent out electronically in ten weeks, during the second week of December 2012. The review shouldnt take more than a few hours to complete and will take place between the following dates: December 12- Reviewer receives review materials electronically December 13- Reviewer returns reviews electronically I look forward to receiving your keen feedback. Please identify any errors in grammar, style, spelling and layout. As we agreed, you will be sending me the materials to review your latest in-the-works project. Thank you for your consideration. Kindest regards, Jeanette Novakovich Assistant Professor, English Department Concordia University, Montreal QC

2012 Novakovich

48

PERFORMANCE INTERVENTION

49

DRAFT #2 To: <editorial reviewer> From: Jeanette Novakovich Date: 7 December 2012 Subject: Portfolio-Remix Performance Intervention

Hello, Thank you for agreeing to review the training materials for Portfolio-Remix Performance Intervention. The review materials will be sent out electronically in five days, during the second week of December: December 12- Reviewer receives review materials electronically December 13- Reviewer returns feedback electronically I look forward to receiving your feedback. Kindest regards, Jeanette Novakovich Assistant Professor, English Department Concordia University, Montreal QC

2012 Novakovich

49

PERFORMANCE INTERVENTION

50

DRAFT #3 To: <editorial reviewer> From: Jeanette Novakovich Date: 12 December 2012 Subject: Portfolio-Remix Performance Intervention

Hello, Thank you for agreeing to review the training materials for Portfolio-Remix Performance Intervention. Please find the following items attached for the editorial review: Instructors manual Learners handout Storyboard for web entries Stylesheet The overall objective of this review is to note any grammar, style, spelling or layout errors. Please feel free to make comments and corrections on the electronic drafts. I look forward to receiving your feedback on Tuesday, December 13th. Kindest regards, Jeanette Novakovich Assistant Professor, English Department Concordia University, Montreal QC

2012 Novakovich

50

PERFORMANCE INTERVENTION

51

PERFORMANCE INTERVENTION STYLESHEET

Canadian English Style Guides:

The Canadian Style: A Guide to Writing and Editing (1997). Dundurn Press, Public Works, Government Services Canada. Canadian Oxford Dictionary. Online reference: http://www.oupcanada.com/reference_trade/canadian_oxford_dictionaries/dicti onary_online.html

Preferred Web Entry Layout:

Introductory and close-out slides standard PPT heading and bullet list summary. Content or unit slides: Assertion-evidence style that includes an assertion in the header followed by visual evidence. Furthermore, each unit includes an introduction to the troubleshooting area, provides a tip to solve or prevent the problem, and concludes by explaining the best practice. Clean crisp slide layout. Warm beige background, crisp modern black font, and white background for text. Delicious font for heading: size 28pt Delicious font for text: size 16.5pt Red spot color in visuals

Course Materials:
Euphemia UCAS font for headings: size 14 pt + Euphemia UCAS font for text: size 12 pt Maroon red spot color Preferred active voice Technical jargon defined in text boxes
2012 Novakovich 51

PERFORMANCE INTERVENTION

52

REFERENCES
The Canadian Style: A Guide to Writing and Editing (1997). Works, Government Services Canada. Canadian Oxford Dictionary. Online reference: http://www.oupcanada.com/reference_trade/canadian_oxford_dictionaries/dictionary_ online.html Carliner S. (2003). Training Design Basics, Baltimore, MD: ASTD Press. Dundurn Press, Public

Note: Some text adapted from Carliner, 2003.

2012 Novakovich

52