Second language acquisition researchers have been greatly interested in the relationship between motivation and language learners(IU(J proficiency. Early studies identified two learning motivation orientations, integrative and instrumental, in second language learners with the former orientation considered as more advantageous to language learning. However, research results on the question of integrative versus instrumental attitudes and motivation in language proficiency have been mixed and contradictory. Researchers now see motivational orientation(s) as emerging and varying from one learning context to another (Clement & Kruidenier, 1983; Crookes & Schmidt, 1991; McGroarty, 1996; Oxford & Shearin, 1994).
For teachers, the origin and extent of their students(IU(J motivation to learn a language demands consideration for
(IR(Jwithout knowing where the roots of motivation lie, how can teachers water those roots?(IS(J (Oxford & Shearin, 1994, p. 15).
The purpose of this study was to determine possible factors which contribute to and influence motivation in Japanese students(IU(J EFL learning, and to create a reliable and valid instrument to measure aspects of this motivation.
We took Kunnan(IU(Js (1994) approach to construct validation using structural equation modeling (SEM) analysis. SEM brings together multiple regression, path analysis and factor analysis to offer a (IR(Jmechanism to hypothesize relationships between constructs and measured variables and among constructs based on substantive theory(IS(J (Kunnan, 1998, p. 2). We investigated the relationships between EFL students(IU(J motivation as measured by a researcher-developed instrument controlling for their performance on a proficiency test, the Comprehensive English Language Test (CELT) (Harris & Palmer, 1986).
Method
Participants
A total of 110 Japanese university students from a private women(IU(Js school in Tokyo and a private co-ed institution in Saitama participated in this study. The Tokyo women(IU(Js university students, 38 juniors, ages 20 to 21, were English/English Literature or Intercultural Studies majors enrolled in a teacher-training program. All of the women students, but one, a returnee from Brazil, were Japanese speakers. The Saitama co-ed university students who were all Japanese speakers, 15 females and 57 males, ages 19 to 22, included first-, second-, and third-year Economics majors in elective English classes.
Instruments
Comprehensive English Language Test. According to a review by Oxford (1987), CELT was designed for high school, college, and adult nonnative speakers of English at the intermediate and advanced levels to assist in the placement and assessment of progress in ESL and EFL courses.
The 1986 edition of CELT consists of parallel forms, Form A and Form B, which Oxford (1987) reported as appearing to be (IR(Jparallel and interchangeable(IS(J (p. 23). Form A was used in this study. Each form has three sub-sections, Listening (40 minutes), Structure (45 minutes), and Vocabulary (35 minutes), and is scored on the percentage of items answered correctly, with omitted items scored as incorrect.
CELT was chosen by the researchers for this study because it was easily available to them, and easy to administer and score. Furthermore, Oxford (1987) described this proficiency test as (IR(Jreliable, valid, and useful for nonnative speakers of English(IS(J (p. 24).
An internal consistency estimate, the theta coefficient, which is based on principal components analysis, was calculated for the CELT sub-tests. Following Zeller and Carmines (1980, p. 61), a principal components analysis using a listwise deletion procedure was run on the three sub-tests. A listwise procedure was used in order to get the total number of students who took all three sub-tests. The Listening, Structure, and Vocabulary tests loaded strongly (all over .80) on one factor and the eigenvalue, 2.04074, along with the number of students who took all sub-tests, was converted to theta resulting in a coefficient of .52 (n = 83). The low n size was due to student absences on one or both of the class sessions on which the sub-tests were administered. According to Ary, Jacobs, and Razavieh (1990), (IR(Jif the measurement results are to be used for making a decision about a group or even for research purposes, a lower reliability coefficient (in the range of .30 to .50) might be acceptable(IS(J (p. 282).
Motivation Questionnaire. Following, generally, the stages and steps in the construction of research instruments proposed by Griffee (1997) and O(IU(JBryen (1996), the researchers developed a questionnaire on student motivation in learning English as a foreign language.
After examining the literature on motivation studies in ESL and EFL settings, the researchers adopted the assumption that a variety of factors contribute to and influence motivation for foreign language learning. They compiled a list of items in English based on several motivation studies (Johnson, 1996; Johnson & Takeo, 1996; Schmidt, Boraie, & Kassabgy, 1996), and their intuition as experienced EFL teachers in the Japanese educational system. This list was divided into components adapted from the models of motivation described in Crookes and Schmidt (1991) and Schmidt, Boraie, and Kassabgy (1996) resulting in a six-component 45-item questionnaire. The six components were Extrinsic Motivation, Intrinsic Motivation, Attitudes Toward the English Language, Motivational Strength, Expectancy/Control, and Anxiety (see Appendix A). (In addition, four open-ended questions were appended to the questionnaire.)
The researchers decided to translate the questionnaire into Japanese, keeping in mind that the translated version would not be exactly analogous to the original English version. Knowing their students(IU(J limited reading comprehension ability in English, they thought that a translated version would capture more accurate responses than the English version.
One of the researchers, a native speaker of Japanese, translated the questionnaire items into Japanese. The items were then back translated into English by two other native speakers of Japanese, both experienced EFL teachers, who were also asked to check for and change any awkward Japanese expressions. The original English version and back translations were compared by the researchers and a few changes in wording and expressions were made on both the English and Japanese questionnaires. The Japanese questionnaire items were then randomly ordered. Finally, a Japanese/English bilingual American EFL teacher (a colleague of one of the researchers at the Saitama co-ed university) read both the Japanese and English questionnaires checking the clearness and appropriateness of the items. Several words and expressions were then changed or corrected by the researchers.
The questionnaire (see Appendix B) used a five-point Likert-scale by which students indicated how much they agreed with each item: 5 = I completely agree (mattakusonotooridearu, mattakusouomou), 4 = I agree (sonotooridearu, souomou), 3 = I neither agree nor disagree (dochiratomoienai), 2 = I disagree (soudewanai, souwaomowanai), and, 1 = I completely disagree (mattakusoudewanai, mattakusouomowanai). All items, except the Anxiety items, were worded positively. Since the items in the Anxiety component were worded negatively, they were reverse scored when the response data were input onto a spreadsheet for analysis. Our goal was to consolidate the survey into interpretable indicators and factors.
A principal components analysis of the responses to the 45 items by the 110 university students extracted 11 factors which were largely uninterpretable. A factor analysis with varimax rotation extracted 12 factors which were also difficult to interpret. Next, a factor analysis with varimax rotation and forced extraction of six factors was run on the data. The number of factors, six, was used for the forced extraction because the motivation instrument was formulated to have six components. Twenty-nine items, with loadings higher than .30, which loaded most meaningfully on the six factors were chosen by the researchers. According to Hatch and Lazaraton (1991, p. 494), a loading of .30 or above is considered an acceptable link between an item and a factor. A subsequent factor analysis with varimax rotation and forced extraction of six factors was run on the 29 items. Five items were then eliminated because they were uninterpretable and another factor analysis was run on the remaining 24 items. From this final factor analysis, 19 items which loaded on the first four factors were selected on the basis of their high loadings and interpretability (see Table 1). The last two factors were eliminated because the items which loaded on them with higher than .30 values did not coalesce into meaningful categories. The final 19 items comprised four components, two of which were renamed by the researchers as Perceived Effort (Effort) and Desire to Speak to Native Speakers (Desire).
Analysis and Results
The Motivation Model
Using EQS (Bentler & Wu, 1995), relationships were examined between Motivation, a second-order latent variable and three first-order variables: (a) Effort, a latent variable with five indicators, Motivation Questionnaire Items 28, 31, 33, 34, and 36; (b) Attitudes, a latent variable with five indicators, Items 8, 14, 22, 23, and 24; and (c) Desire, a latent variable with five indicators, Items 6, 13, 18, 20, and 27. Two other latent variables, Anxiety with four indicators, Items 41, 42, 43, and 45; and CELT, which represents our proficiency construct with three indicators, sub-tests Listening, Structure, and Vocabulary, were used as control variables on Motivation. The hypothesized model is presented in Figure 1. Ovals represent latent variables, rectangles represent measured variables. E1 stands for the residual error for variable 1 (Listening), E2 means the residual error for variable 2 (Structure), and so on. The paths not marked with an asterisk are fixed paths.
Figure 1 illustrates the hypothesis that Effort, Desire, and Attitudes contribute to and constitute the Motivation construct. The paths between CELT and Motivation and between Anxiety and Motivation were fixed thus making CELT and Anxiety covariates of Motivation.

Discussion
Our quest for a better understanding of Japanese university students(IU(J engagement in EFL learning has brought us to a model, albeit a limited one, of the students(IU(J motivation. With the students(IU(J language proficiency, a product of their experience, and their language classroom anxiety, a product of their personalities, held constant, we can see that the students(IU(J motivation, or what we have labeled as motivation, is substantially related to three variables, their self-assessed effort to learn the language, their desire to speak to native speakers, and their attitudes toward the English language.
Examination of the means for the CELT sub-tests and for each indicator (questionnaire item) of the three variables show that the students are rather low in proficiency and that although the students do not see themselves as energetic learners, they do covet interaction with native speakers and think that English is an important and valuable language. The implication that we need to encourage more student effort in learning seems obvious.
The means for the anxiety indicators reveal that the students(IU(J language learning anxiety is not high. It should be noted that anxiety does not appear in this context to be an important factor in motivation. Berwick and Ross (1989) describe Japanese university freshmen as (IR(Jexam-worn(IS(J survivors with little or no motivation to learn or study once university entrance examinations are over (p. 206). It may be that the stakes for success or failure are no longer high for students in a Japanese university milieu.
A little facilitative anxiety may need to be induced in the students. It was observed by one of the researchers that some of her students at the Tokyo women(IU(Js university who were anxious about an upcoming homestay in the U.S. and worried about their speaking skills decided to take extra conversation classes.
Berwick and Ross (1989) note that motivation increases in adult post-university learners who take English conversation classes to help them in their work-related or travel purposes. Motivation may also increase in third or fourth-year students who are preparing for employment interviews and who may wish to add English proficiency test scores to their resumes.
The path coefficients or parameter estimates for this structural equation model provide information on the reliability and validity of our instruments (Sasaki, 1993, p. 338). The coefficients, ranging from .27 to .87, for the paths from the first-order variables (CELT, Effort, Attitudes, Desire, and Anxiety) to the measured variables suggest that these observed variables are reliable measures of what they were hypothesized to measure. The paths from the second-order variable, Motivation, to the first-order variables, Effort and Desire, had relatively high estimates, both .89, suggesting high validity for these hypothesized factors. The path from Motivation to Attitudes, and the path from CELT to Motivation, .42 and .46 respectively, were only moderately strong, thus indicating relatively lower validity for these factors.
The instruments, CELT and the 19-item Motivation Questionnaire, are reliable and valid only for the sample of students in this study. Since the chi-square statistic was found to be significant, we cannot generalize our findings to the whole population of Japanese EFL students nor ensure the reliability and validity of the instruments if they are used with other populations.
Limitations
Several limitations of this study should be noted:
- Although structural equation modeling requires a large sample size, we were unable to meet this design requirement. Future studies should meet this assumption.
- The assumption of multivariate normality was not strictly met.
- Since the questionnaire items, except the Anxiety items, were worded positively, there is a possibility of a response set in the data. The students may have been trying to answer consistently; their responses to the five Attitudes items were uniformly positive. The histograms of the measured variables for Attitudes show that the data were slightly negatively skewed. This may, however, show this population sample as it really is(IQ(Ja group with positive attitudes.
- The final Motivation Questionnaire data used in the SEM analysis were comprised of only 4 components and 19 items, resulting in a rather limited model of motivation.
Conclusion
The researchers have discovered a little more about our students(IU(J motivation for EFL learning, and we have established the reliability and provided some support for the validity of the 19-item Motivation Questionnaire and the CELT for our population of learners. Our cross-sectional, small sample-size study was exploratory in practice and limited in findings. However, these findings, especially the strong relationships between Motivation and Effort, and between Motivation and Desire to Speak to Native Speakers of English, might encourage teachers to reexamine how their own students' motivational factors in EFL learning affect their language development. A next step may be a longitudinal study using pre- and post- proficiency tests in order to observe how and if student engagement and persistence in EFL learning change over time and instructional experience.
Other ways of investigating and reaching a deeper understanding of the complexity and uncertainty in the human endeavor of language learning may include exploring motivation using a qualitative approach. For example, motivation in learning, reevaluated as social identity and investment in learning, can be examined within a social context framework (e.g., McKay & Wong, 1996; Peirce, 1995).
Acknowledgements
We wish to thank Joyce Maeda, Yukiko Furujiku, and Keiko Ozaki for their invaluable assistance in and support of our study.
Ethel Ogane teaches at a private language school and private universities in the Kanto area. She is a doctoral candidate at Temple University, Japan Campus.
Masako Sakamoto, a doctoral candidate at Temple University, Japan Campus, teaches at Bunka Women(IU(Js University. Her research interests include teacher education, learner autonomy, and writing.
References
- Ary, D., Jacobs, L., & Razavieh, A. (1990). Introduction to research in education (4th ed.). Harcourt Brace.
- Bentler, P. M., & E. J. C. Wu. (1995). EQS (Mac Version 5.0) [Computer software]. Encino, CA: Multivariate Software, Inc.
- Berwick, R., & Ross, S. (1989). Motivation after matriculation: Are Japanese learners of English still alive after exam hell? JALT Journal, 11 (2), 193-210.
- Clement, R., & Kruidenier, B. G. (1983). Orientations in second language acquisition: The effects of ethnicity, milieu, and target language on their emergence. Language Learning, 33 (3), 274-291.
- Crookes, G., & Schmidt, R. W. (1991). Motivation: Reopening the research agenda. Language Learning, 41 (4), 469-512.
- Griffee, D. T. (1997). Validating a questionnaire on confidence in speaking English as a foreign language. JALT Journal, 19 (2) 177-197.
- Harris, D. P., & Palmer, L. A. (1986). Comprehensive English language test. New York, NY: McGraw-Hill Book Company.
- Johnson, J. (1996). Learning orientations, motivation and EFL proficiency in first-year Japanese university students. Temple University, Japan Campus Working Papers in Applied Linguistics, 8, 50-58.
- Johnson, J., & Takeo, M. (1996). Learning orientations and motivational strength in Japanese university students. Temple University, Japan Campus Research Studies in TESOL, 3, 1-10.
- Kunnan, A. J. (1994). Modelling relationships among some test-taker characteristics and performance on EFL tests: an approach to construct validation. Language Testing, 1 (3), 225-252.
- Kunnan, A. J. (1998). An introduction to structural modeling for language assessment research. To appear in Language Testing.
- McGroarty, M. (1996). Language attitudes, motivation, and standards. In S. L. McKay & N. H. Hornberger (Eds.) Sociolinguistics and language teaching, (pp. 3-46). Cambridge: Cambridge University Press.
- McKay, S. L., & Wong, S. C. (1996). Multiple discourse, multiple identities: Investment and agency in second-language learning among Chinese adolescent immigrant students. Harvard Educational Review, 66 (3), 577-608.
- O(IU(JBryen, P. (1996). Using questionnaires to assess motivation in second language classrooms. University of Hawai(IU(Ji Working Papers in ESL, 14 (2), 73-125.
- Oxford, R. (1987). Comprehensive English Language Test. In C. J. Alderson, K. J. Krahnke, & C. W. Stansfield (Eds.) Reviews of English language proficiency tests, pp. 22-24. Washington DC: TESOL.
- Oxford, R., & Shearin, J. (1994). Language learning motivation: Expanding the theoretical framework. The Modern Language Journal, 78 (1), 12-28.
- Peirce, B. N. (1995). Social identity, investment and language learning. TESOL Quarterly, 29, 9-31.
- Sasaki, M. (1993). Relationships among second language proficiency, foreign language aptitude, and intelligence: A structural equation modeling approach. Language Learning, 43 (3), 313-344.
- Schmidt, R., Boraie, D., & Kassabgy, O. (1996). Foreign language motivation: Internal structure and external connections. University of Hawai(IU(Ji Working Papers in ESL, 14 (2), 1-72.
- Tabachnick, B. G., & Fidell, L. S. (1996). Using multivariate statistics (3rd ed.). HarperCollins College Publishers.
- Zeller, R. A., & Carmines, E. G. (1980). Measurement in the social sciences. Cambridge: Cambridge University Press.