This Project is framed in the mobile assisted approach to the learning of languages (MALL) and aims at testing the prototype of a multiple choice question-answer game to review grammar, vocabulary, language use and reading comprehension at the B2 level according to the CEFRL. The prototype is already planned to be designed within the GIEM and would be finished during the development of the project. The improvements on the application and final functionalities are expected to be decided and agreed throughout the project and after analysing the results of a pilot test at the UPM. This test pursues a double aim:

First, to analyze the extent to which the use of the application motivates the students and has a positive impact in their learning: questionnaires are proposed to assess results regarding students’ motivation and pre and post test statistical techniques would be used to evaluate eventual proficiency improvement on the part of students.

Second, it also aims at gaining information from the testers about other more technical aspects such as usability and user experience obtained by the use of the mobile learning prototype application. Any mobile application has great sensitivity to user-interface issues, even to the point of determining the success or failure of it at the same level as the functionality itself. Testing these technical aspects in the local framework will give us a very valuable insight into the similarities and differences that users of different profiles exhibit towards m-learning Apps.

*The Intagrated Language Learning Lab is willing to also maintain the cycle "Around the World in English" which has been highly evaluated among participants and is providing the UPM channel with valuable audiovisual materials according to the GATE.

Roles have already been distributed among participants. The team at the GIEM is integrated by researchers from the area of Telematics who will basically be in charge of the design and development of the application; a researcher from the area of business administration who will define the steps to take and supervise the quality of the project and will be also in charge of data analysis; and a researcher from the area of linguistics who will propose the initial repository of questions and answers for the mobile application.

 

Preparatory phase

 

Phase 1

Autumn/Winter 2014 approximate agenda:

Presentation of the prototype idea and design.

Dates for pre-pilot test.

Questionnaires design.

Study and design of qualitative and quantitative data collection and data analysis to be performed.

 

During the first part of the project development, the first prototype will be designed and implemented. Also, the first set of learning material (questions to be used in the prototype test) will be produced. Later, also during the first part of the project, this first prototype will be tested by a pilot group of informants. 

 

Phase 2

Spring 2015 approximate agenda:

Evaluation of first results obtained in data collection and data analysis.

Actions based on results.

Improvements to the application.

Presentation of the application improved. 

 

A task related to techno-learning assessment is going to be carried out. Inside this, qualitative and quantitative indicators will be used in order to measure the results. These indicators must be applied during the long term project process as well as every time a phase finishes and at the end of the project itself.

Regarding the qualitative study, open questionnaires are proposed in order to measure the auto-efficiency observed on the part of the students as well as for the analysis and attitudes towards the adaptation to the platform and the competences acquired.

The indicators to measure academic results will be based on statistical methods generating an experimental group and a control group in order to carry out pre-course and post-course analyses.

A descriptive parametric methodology will be applied as can be t-student statistics, covariance and ANOVA, among others, with the aim to test if the hypothesis of learning improvement of students towards the level B2 (CEFRL) through the use of the application

can be corroborated. Data will be collected by means of close qualitative questionnaires.

A number of indexes have been defined for the monitoring of the platform in order to measure eventual modifications in the learning process through the use of a m-learning methodology, which will consider:

• The learning results within the platform: (time spent in answering, number of correct answers, number of task repetitions, etc).

• Time employed within the platform on the part of the students: periods of time they use (just in time, short interval time).

The development of a report after every phase covered has also been defined where an evaluation matrix will be included for the analysis and control of the project quality.

Within the dissemination activities, and as a quality measure, the results obtained will be published in international journals and conferences of reference in the subject matter.

 

(See Figure 2 attached for detail)