using the pin&play interface for games and entertainment

Meeting Minutes

31st January

Meeting was held from 2pm until 4pm. The constraints meetings were overviewed, and some initial ideas were discussed.

Ideas & directions for CDP Play Group

Electronics Teaching Board

This board would be used to help teach children (and potentially adults, depending on variations) on the basics of electronics. Different component Pins could be assigned to different components, e.g. battery (and thus more batteries = more power), ammeters, voltmeters, bulbs, buzzers etc. It would be wireless, and be based on the correct addition of components. Variable resistors could be represented using the slider bar.

Removing certain components (like Ammeter) would not affect it, and others would (removing battery). LED display chips could be used as a software programmed ammeter/voltmeter. You could add sequences, and use it to do mock ups of components. This would have an educational application, but its tangible nature could easily adapt it into a game.

Multiplayer Etch a Sketch

This would entail using rotational dials to provide the similarity of etch a sketch vertical and horizontal controls. Double this up on the side or opposite end on a large enough fabric and it could be multiplayer. Different coloured lines could be added via the presence of chips or not, or by using an RGB colour mixer consisting of 3 dials and a coloured LED light. Different components could be added depending on the skill of the player.

Sound Board Fabric

This idea has a variety of applications. It could be used as a game (i.e. prank calls!), educational purposes such as languages, and record your own voices. How it would work would be to have basic buttons pressed that would activate a sound/recording. A microphone could be inbuilt to record your own phrases.

For the Language Board, different areas could be assigned to different locations, e.g. Greetings in top right, one liners in top right, dependant on user choice. Language chips could change this instantly if used by teachers. A space could be put for creating sentences by placing them in order, or pressing them in order.

For the Pranks/Silly Sounds, it could be as many or few sound chips as you like, adding them real-time if needed. Again, by assigning greetings, one liners, or jokes in different areas, you could change profiles on the computer or with profile chips.

Anagram Game

Initially from a Scrabble game, then a spell checking game, an anagram game would negate the use of sequential order to create a pin and play Anagram game. Either put in your own letters and let software solve your game, as a tangible but basic anagram machine. Or play against the PC with the computer generating the letters, and after solving it (plug them in to solve), then you need to input them the correct sequence to win. The LEDs generating random letters (but known to the computer) could work.

Tangible Hangman

Similar to the one above. You would put in letter generating LEDs, the number would tell the computer how big a word to generate. You would add letters into the fabric, it would display if it came in or not. A buzzer could sound to show “wrong”, or if this was integrated with a PC, you could see on screen. You could put letter attempts anywhere you like, or if you wanted to assign areas, it could be integrated into quadrants.

Other key points and considerations

Referencing is important, some crude method of referencing would greatly increase the fabrics use potential. Simple referencing could be done via multiple pieces stuck together, and then a “master” fabric above it to hide connections and joints.

For e.g., this would allow a tangible chess game.

Magnetic Referencing,

Similar way of referencing, see diagram notes from meeting. Perhaps similar segments, but chips already embedded. Then a magnet placed on top would activate that chip. Basically another form of activation rather than pressing a button/turning a dial.

This could also serve as a safer way of interacting with the board. A problem is you do lose some of the flexibility of being able to pin anywhere or anything, but safety is a big concern.

Foam padding

Foam padding under some components could address the safety issues and free up potential users.

Other Potential Ideas/themes mentioned:

*Mr. Potato Head

*Mini Golf

*Lego/3D Bricks

2nd February

Concepts & Prototypes to be Designed

Ideas

Hangman
Language Soundboard
Electricity components
3D Potato Head concept
Domestic Media Control
Customizable Pinball Game
Pokemon-style “card game”

Additional idea: Multiplayer etch a sketch

These several ideas have been sorted in several general categories:

1) Simulation of real world systems
2) Educational Support
3) Language development
4) Home Entertainment/ Domestic Use
5) Children Games
6) Adult Games

Another way to sort these ideas:

– Lexicon-based – Sound-based – Vision-based – Multi User – 3D based – Control Systems – Motion-based – Sensor-based

Division of prototyping tasks:

Pascal :
3D Potato Head concept
Pokemon-style “card game”

Gen:
Hangman
Electricity components

Zain :
Language Soundboard
Domestic Media Control
Customizable Pinball Game

7th February

Brief meeting to check up progress on initial conceptual designs and development.

Main ideas and features sorted, but yet to be finalised.

It was decided that initially, the pictures should demonstrate and help visualise the prototypes, and not necessarily have to be the final versions.

Hand drawn pictures were deemed suitable to convey the key themes of the prototypes, with annotations used in both computer and hand drawn versions.

Would discuss and present to Corina and Group Work tomorrow at CDP weekly meeting.

8th – 14th February

 Zain in hospital with appendicitis. No formal meetings.

Website was developed during this time.  

15th February

 Brief Meeting, but then postponed to Thursday 16 th Feb. 

16th February

Decided which conceptual areas to add additional prototypes. The following prototypes were developed and brought to the meeting:

Pin Doctor

3D Dress Selector

Multi Board Game

Simon Says Memory Game

Safe Cracking Game

House/ Garden Pin Design

Spatial Soundboard

Pin & Fight

These would be divided up and further developed with Concepts and appropriate prototypes. We would think about this and meet tomorrow and bring any further developments and thoughts to the matter.  

17th February

 Decided given group size difference and other problems, we would only concentrate on 15 prototypes.

Looked further at prototypes, critically discussed some potential limitations, and modifications to the concepts were made.

20th – 21st February

Online Meetings from Evening of 20 th until Morning of 21 st

Work transferred and edited, reviewed, and discussed online. Prototypes emailed around.

Final document formatted, integrating concepts, prototypes and diagrams within single document.

Suggested original colour theme from website used to continue formatting document. Green and dark yellow tones used.

22nd February

Quick meeting to ensure we had evaluation sheets ready for other group.

Suggested we make additions and developments on the website.

  1. Upload Concepts
  2. Upload Prototypes
  3. Upload Diagrams/ Pictures

25th February

Quick Online Meeting

Decided introduction sections and overviews for various website sections required. Introductions to each section written up and uploaded.  

1st March

Discussed potential choices for final prototypes.

Considered doing one or two:

One would allow more focus, but may be a bit limiting in terms of showing off the functionality or a range. Two would be more range, but may not allow as much focus.

Suggested a fair amount of focus could still be achievable.

Also decided that if two prototypes were chosen, one should be more conceptual or with further development (in terms of feasibility or actual modelling), and one should be simpler (in terms of possibly creating a physical TUI).

Various scores looked at. High scorers and good comments for Pin Doctor, Garden Design, Safe Cracker, and 3D Potato head.

Decided Potato heads 3D element could be integrated into Pin Doctor, which had a lot of scope. Could have 3D model, perhaps different patches (like a CPR dummy), different areas for Pin interaction. PC inside or processors internally, as well as input to GUI if needed for advanced modes. Injections/medicine etc could be administered.

Other chosen prototype was Safe Cracker as it was simple in concept but had massive expandability and many combinations. Could be integrated with timers, could be deactivating a bomb, could be memory based tool. Could even be used for problem solving psychological experiments. Sequences, learning, and memory depending on colour, sound, location, times, mistakes, etc.

Decided a few personas per prototype could be done to think about typical users. Then one scenario at least to give a context of use. 1 HTA per prototype based around a scenario and function.

Action:

4 Personas

2 – 4 Scenarios

2 HTAs

2nd March

Met briefly to discuss potential ideas for personas. Considered children would be a good angle given nature, as well as adults in the supporting environment.

Each tasked with trying to come up with some personae each, and then divide HTAs and Scenarios at a later stage.

7th March

Online meeting

Developments on Persona and scenario emailed round and briefly discussed.

Some changes to HTA’s made in light of changes to scenarios and clarifications on personae.

Potential ideas for further developments of prototypes briefly discussed (such as same use from different perspectives or personae). Will present personas, scenarios and HTA developments with Corina tomorrow.

8th March

Meeting with Corina briefly to communicate developments in HTA, scenarios and personae. Communicated that currently, two prototypes are being considered to run in parallel for final demonstration. Was suggested that this may be reduced to one depending on development and time constraints.

10th March

Major points from meeting with Corina communicated and discussed. Further development of the type of interaction with PinDoc was described.

Was discussed and decided that a scenario in the form of a storyboard would be presented, as this would look good on the poster, and illustrate the main points of the scenario.

Was decided that personae would take the form of a “persona profile”, to give the indicators and features of a persona, but not in solid flowing text, rather bullets and key points.

Screenshots for GUI interface developed in more detail. Would be turned into a permanent feature of the interaction, deciding that it could be a necessary part to enable long term use, different skill, and appropriate feedback.

Went through some GUI iterations, decided on the main features that would be present on a screen. Would include as a basic minimum:

Heart rate (ECG)
Blood Sugar Level
Temperature
Blood Pressure
- Perhaps medication?

14th March

All day, early afternoon till late evening.

Doll was shown and explored. Worked well with existing pins as pins would stick in and remain in place. Demonstrated PinDoc concept well, and had added bonus of making sounds which would demonstrate tangible and audible feedback .

Screenshots made for GUI interface would serve to demonstrate interaction with doll, and a few more were created on the day to prepare for video recording. A few aesthetic changes made given doll considerations.

Pins were manufactured into mock medical components. Syringe was modelled using a sliding variable resister bar covered in plasticine shaped into a syringe. Slider bar would act as a plunger, and the pins on the slider were bent so they could be inserted into the fabric / doll.

Oxygen and gas mask was made using a board rubber, string, and corrugated cardboard to curve around dolls mouth and nose. Many attempts later, a fit was found.

A drip was fashioned out of a soft drink can wrapped with reflective aluminium foil plastic to show reflective liquid, and attached via a string and pin. Other pins included blood sugar level pin, blood pressure monitor, and an ECG pin for heart.

Main task for was recording video for presentation. Props were set up in several rooms with GUI intended to be displayed on the projector. Rooms became subsequently unavailable, and after much moving, returned to MRes room to use an LCD panel. Many takes taken from different angles, and re-recordings done several times. Excess material was recorded just incase, but was intended to be cut down.

15th March

Multiple meetings all afternoon and evening.

Mock presentation shown to Corina and other group, feedback recorded. Several comments and suggestions made. Video shown, needs changes. Narration may need to be reconsidered.

Doll seems to work well, but more advanced pins may be needed.

Detailed Meeting held afterwards where everything from morning meeting documented, and the poster was conceived planned and segmented.

Pin Doctor Developments

Game Play

Start:

Splash screen to show game selection and confirmation of levels / game / random.

System admin could be incorporated to control Doll & Illnesses remotely.

Introduction of illness / profile, e.g. “This patient has arrived, has high BP, lots of pain, had a gunshot wound to her left leg”.

Playing

Level can be dynamically changed in the middle, i.e. increase/decrease hardness. Pressing game pin will start a new game immediately.

Advanced Interactions

Less detailed/descriptive hints. Less visual information, more numbers and statistics for “doctor” to make inferences. I.e. no colour boundaries for blood pressure, diagnosis has to be made from amount.

More emphasis on correct sequence of events (perhaps more conceptual), so the order of medication will have implications.

Stricter reactions to mistakes, i.e. patient may die on advanced settings, compared to points reduction on beginner levels.

Advanced Games

X- Ray function - (shows up skeleton, and hints may or may not help identify areas of interest on picture)

fMRI Brain Scans – Looking for brain tumours

Blood Oxygenation Level – range of oxygen present in blood

Advanced Equipment

Defibrillation / Crash Team

Blood Testing

CPR Kit

Breathing Kit

X-Ray Machine / Pin

Medicines

Insulin – Syringe Based

Antidotes – Syringe Based

Intubation

Stomach Pump (need tubes pinned on mouth)

Peripheral Equipment

Drugs Store: Will store different drugs (e.g. insulin, morphine, glucose etc) which can be up taken into syringes. Will also incorporate a “cleaning pad” where blood can be checked, and syringes can be cleaned between different injections. Injecting twice without cleaning = points reduced on beginner, or patient may die on advanced mode.

Booklet/glossary pins

Alert Mechanisms

Audio Alerts

- “Warning, patient is ………”

- *Beep*/ *Buzz*

- “Please give patient ……..”

Visual Alerts
Poster Design/Layout Ideas

Introduction

Pin and Play, Play focus, several prototypes to final presentation, intro to how it may work functionally

Conceptual Development Points
Prototype
Scenarios & Personas
Different potential uses
Real world manifestations
HTA for entire system
Future developments / directions
Key / Annotated Diagrams

18th March

Online meetings throughout the day. Quick update on progress made so far.

HTA’s taking shape, still being developed, plan needs to be done. Currently being spread over two separate HTAs as they are too big. Will review tomorrow when progress has been made.

Poster starting to take shape with some basic stuff added. Scenario storyboard created, showing different stages in screenshot form. Reduced from 10 to 8 given space constraints. Pictures added to text as well of doll / interaction.

19th March

Online and telephone meetings. Poster was main focus of meetings, with changes made and revisions made at each review. Mostly resizing, layout and optimisation issues.

Was decided that text would probably be too heavy, and would need to be cut down. Suggested that this could be more appropriate online as a record of all the work and development.

Text would be reduced tomorrow once sizes and dimensions of advanced pins were available.

Segments of the HTA redrafted to reflect different actions. Now suggest being changed into one single HTA rather than two broken HTA’s. Plan practically finished for advanced prototype.

20th March

All day meeting from morning to evening.

Bringing together all different components recently been working on.

Presentation video has been adapted with screen tips, no narration, and text boxes and highlights. Has been reduced so it’s even shorter and sharper. Current size approx under 30mb.

Decided that a web optimised version will be created for the website when possible. Ideally with flash menus, but will depend on bandwidth

HTA complete and plan written up. Has now been redesigned to fit in one large master HTA as oppose to two smaller decomposed ones. Will not go on poster as decided too big, and too complicated for viewers to look at a poster.

Additional “advanced” level pins were brought and displayed, photographed, and added to the poster.

New graphics were added to the poster to make it less text heavy. Pictures were found to match different sections for future work and alternative uses and applications sections. Optimised and added to poster.

Poster taken shape. Finished off and printed today after changes to text were made. Text was reduced, was bullet pointed, and optimised for graphics. Poster was printed off at ISS after much editing, reshaping, and 2 failed prints. Total cost : £9.00, with two posters useable.

Final preparations for planned presentation made. Poster will be put up, video will be displayed on a laptop statically with sound, and the 3D doll will be brought as a live demonstration tool. Will be like an expo, so no formal presentation will be prepared, rather being prepared to talk through and demonstrate various aspects as and when people arrive. Decided against a PowerPoint or formal presentations as it was a “poster session”.