Economics and Management

Evaluation of Course Training Program on Research And Development Management of First Level Defense at Research and Development Agency of Defense Ministry Republic of Indonesia

I Nyoman Astawa, Muchlis R. Luddin, Ma’ruf Akbar,
Article Date Published : 4 April 2018 | Page No.: EM-2018-236-242 | Google Scholar

Downloads

Download data is not yet available.

Abstract

The research objectives are for analyzing, assessing, and improving the course training program on research and development management of first-level defense in terms of improving research resource competencies on Ministry of Defence. The research was using the Kirkpatrick evaluation model. Datum collection techniques were constructed with observation, interview, and documentation. Validation of research has been using data reduction, present and concludes. The research results illustrated that participants who following the training was highly reacted, strong motivated, and process of science transfer well conducted. However, the alumni of the training program on research and development management of first-level defense were not optimally empowered as researchers by the organization either in research and development of the Ministry of Defense or within the TNI. Thus, the out-of-training competency of the training as a researcher has not been empowered by the organization, so the research productivity of the alumni is very low. It is recommended that the Youth ‘Litbanghan’ Training and Training program can be used as a fundamental reference in formulating the functional position of the researcher who can serve as the career path for TNI soldiers.

Introduction

The development of human resources within the Ministry of Defense is directed to support the main tool of modern weapon systems. In the Indonesian defense terminology, there were known national resources that include human resources, natural resources, and artificial resources. There are challenges in empowering defense researchers in addition to mastery of science and technology, as well as motivation and innovation in seeing the environment as a researcher. Empirical analysis ( Ghisetti 2015)[ Pontoni 2015] states the determinants of an analysis are technology, market share, strict policies, and the specificity factor of the company.

Building human resources as defense of a human capital, in line with the results of research ( Alexe and Alexe 2017 ) which states the magnitude of the influence of innovation and human capital on the growth of industry and technology in Romania. It takes intellectual and social investment to foster innovation ( Koroglu and Eceral 2015) and creativity in working to contribute both to teamwork ( Morris et al 2014) and to organizational performance ( Subramony et al., 2018) Efforts made to improve the ability of employees could be gotten through holding education and training by Training Agency of Defence Ministry (Badiklat Kemhan). According to [ Piyali et al., 2012] predictions of effectiveness of training are determined by trainers and literature. While the basic steps to develop the training are job needs [ Pederson, Dresdow and Benson 2013], this is consistent with the need analysis of the training that builds the relationship between the instructor and the objectives of the training and the collaboration [ Harris et al 2014], as with the business world, entrepreneurship education can be undertaken at the University [ Baquero 2017], but skills practice is carried out with a training program.

In line with Leonard S. Pederson, et al in 'Significant Tasks in Training of Job-Shop Supervisors' [ Labadie et al., 2017] examines students of medicine, science, and innovation as programs that increase learning interest and understand their career goals in a level of trust high self. The research and development management of first level defense needs to be evaluated (Arasanz and Nylen 2017)[ 11] so that the benefits from this program can really contribute to capacity building of relationships between researchers and organizations within the context of optimally empowering human resources in defense.

Evaluation as a science and also method, in this research uses the Kirkpatrick evaluation model which executed in February until April 2017 at Center for Education and Training of Defense Management Agency of Education and Training Ministry of Defense Pondok Labu Street on South Jakarta.

Results

Stages of Reaction

Figure 1 :

Increasing of lesson time for the subject matter of the core study is expected to master the scientific and technical field of research becomes increasingly dominant, so the materials taught are materials related to researching such as research management, research methodology, research design, data management, proposal and seminar research.

Widyaiswara is the assignment of functional and structural officials. Based on the assessment of the widyasiwara conducted by the training participants can be seen in the following table:

Category Percentage
Very satisfying 1,85%
satisfying 41,48%
good enough 50,00%
less satisfactory 6,66%

1 Results of Participants' Assessment on Widyaiswara project

Source: processed from the evaluation report of the Training on research and development programs of first-level defense of 2013, 2014 and 2015.

Teaching materials. Training materials prepared in the form of a written script. Based on the assessment of teaching materials used in the training can be seen in the following table:

Category Percentage
Very satisfying 1,66%
Satisfying 28,33%
good enough 61,66%
less satisfactory 8,33%

2 Results of Participants' Assessment on Teaching Materials Training on research and development programs of first-level defense

Source: processed from the evaluation report on the implementation of a training program on research and development management of first-level defense in 2013, 2014 and 2015.

The method used by widyaiswara / instructor in teaching and learning process is andragogy method. The technique of delivering the material through face to face in the form of lectures combined with discussion and question and answer. The following table shows the results from the assessment of training participants as follows:

Category Percentage
Very satisfying 9,33%
Satisfying 46,67%
good enough 37,33%
less satisfactory 6,67%

3 Results of Participants' Assessment of Teaching Methods used in the research and development training program of first-level defense

Media The right and effective learning is one of the important factors in supporting the teaching and learning process. Based on the results of observation on the availability of existing learning facilities at the management center of the Ministry of Defense Training Agency can be seen in the following table:

No Observation Scoring scale
1 2 3 4
1 Whiteboard
2 Flip Chart
3 Overhead projector
4 Sound System
5 TV dan Video
6 LCD Projector
7 Computer
8 Wifi

14 Alins / Alongis used in Training on research and development programs of first-level defense

Note : 1 = not good, 2 = pretty good, 3 = good, 4 = very good

Category Percentage
Very satisfying -
Satisfying 16,66%
good enough 66,66%
less satisfactory 16,66%

5 Results of Participants' Evaluation of Learning Media used training on research and development programs of first-level defense

Source: processed from Head of Course and Inventory Room (DIR) data, as well as training participants' responses in 2017.

Training facilities are the supporting facilities and infrastructure needed in the education and training process. The available tools and infrastructure on the research and development programs of first-level defense in the management center of the Ministry of Defense Training Agency can be seen in the following table;

No Observation Rate Scale
1 2 3 4
1 Class rooms
2 Discussion room
3 Computer Laboratory
4 Library
5 Mess
6 Food Store
7 Meeting room
8 Medical room
9 Praying room
10 Gym
11 Toilet
12 Store
13 Parking lot

16 Training Facilities available from the management center of the Ministry of Defense Training Agency

Note : 1 = not good, 2 = pretty good, 3 = good, 4 = very good

Category Percentage
Very satisfying 5,12%
satisfying 28,46%
good enough 52,06%
less satisfactory 14,36%

7 Results of Participants' Assessment of Training Facilities available from the management center of the Ministry of Defense Training Agency

The committee serves to provide all the needs of participants either from materials, facilities, teachers and other needs related to the implementation of the training. The organizing committee is an officer or an organic personnel from the personnel management center structure of the Ministry of Defense Training Agency. The participants' reaction to the organizing committee can be seen in the following table:

Category Percentage
Very satisfying 6,43%
satisfying 38,46%
good enough 42,06%
less satisfactory 4,05%

8 Results of Participants' Assessment of the Organizing Training Organizing Committee available from the management center of the Ministry of Defense Training Agency

Based on the participants' reaction to the 42.06% training organizing committee stated that they are satisfied, it shows that the service on the committee is good in the implementation of the training.

Learning Stages

The aspect that is evaluated in this level is the motivation to learn and increase the competence of training participants.

  1. The motivation to learn the training participant is very different. The results of observation shows the activity of participants during the learning process is always colored by asking for something that is not understood. This happens because the source / origin of the training participants not all come from scholars who have known the theory and methods of previous research.

  2. Increased competence based on the results from the evaluation of learning shows an increase, it can be seen in the following table:

  3. Table 1.9. Assessed Test Results of Participants before and after following used training on research and development programs of first-level defense.

2015 2016
Post Test Post Test
The highest score 64,44 65,00 60.00 80.00
The lowest score 31,11 31,11 30.00 37.50
average 49,33 49,77 47.00 50.43

Source: An evaluation report on education and training on research and development programs of first-level defense

The results from the assessment of the presentation include academic, personality and physical values ​​of training participants who can be seen in the following table:

Table 1.10. Result of Assessment Achievement learners training on research and development programs of first-level defense

Source: Implementation evaluation report of the training of 2013-2016 Result2013201420152016The highest score84,0286,3986,2087,23The lowest score78,3281,0681,4580,07average81,9483,2383,7183,65 Result2013201420152016The highest score84,0286,3986,2087,23The lowest score78,3281,0681,4580,07average81,9483,2383,7183,65

Based on the findings above shows that there is an increase in competency capacity of training participants. Post test results have increased compared to before the training, then the results from the assessment of student achievement based on academic and physical values above 80. This result means that the implementation of training programs on research and development management of first-level defenses very good based on test scores and able to improve the competence of training participants.

Behavior Stages

At this stage of evaluation, Behavior is assessed is the change from the behavior of training participants, including the alumni after they returned to working in their respective organizational units. Based on the observed data of alumni observation, there is a change of knowledge and skill aspect. However, the science obtained cannot be applied to the work environment, because the task and function, there is no relevance to the outcome of training. The last data shows the year 2016 of the participants 30 people only two people (6.67%) derived from institutions of Research and Development while the remaining 28 people (93.33%) came from non-Research and Development institutions. From the above data, change from the behavior of alumni is very difficult to measure because the knowledge and skills acquired after attending the training are faced with their tasks, and work functions are very different.

Stages of Results

The findings in the field, alumni who work or served in the environment R & D are very a lack of this can be seen through the picture below:

Figure 1.2 :

Figure 1.3 :

Figure 1.4 :

From the picture above shows that the R & D human resources which have educational qualifications training on research and development programs of first-level defense under 20%, can also mean that effort to increase the capacity of human resources researchers who come from R & D institutions is very lacking. There are 190 alumni training programs on research and development management of first-level defense during the 2013-2016 timeframe. From the data, which is assigned in the Research and Development Agency only 18 people and even then not entirely become researchers. The remaining 172 alumni are scattered in various entities with duties and functions outside of the study, so that the training alumni have not been optimally empowered by the organization and its leadership, resulting in the productivity of the research results is absent or very low.

Discussion

As the theoretical reference and research results presented earlier, the results of field observations and studies of the results of interviews in the following discussion as follows:

Stages of Reaction

Training on research and development programs of first-level defense is a Brain Power investment program that is an intellectual capital. TNI soldier who becomes training participants is an investment. The learning process is well prepared, ranging from a curriculum developed and implemented based on goal-oriented principles, educational relevance, efficiency, effectiveness, flexibility and sustainability, teaching materials, learning materials, learning methods, learning media, facilities, committees, and other supporting instruments. It is based on need's analysis (Allal-Chérif and Bidan 2017)[ 12] as the internal and external influences of a five-dimensional collaboration: relationships, culture, knowledge, innovation, and desires. Against the readiness, all participants in the training gave a very positive reaction.

Learning Stages

A person is said to have learned if there is a change in behavior that is permanent or fixed behavior. Field observation data stated that all alumni had mastered the knowledge about R & D obtained from teaching-learning process in Ministry of Defense R & D. Implementation of the training is seen from the effectiveness of the implementation of training programs that develop job need analysis ( Pederson et al., 2013) still not directed.

The results of field objectivities and document studies show the motivation of high education participants with the dynamic of a strict learning process. Similarly with the results from the training, the data show the increased ability of participants either in mastery of science with the methodology, as well as innovation and critical thinking.

Behavior Stages

In the report on R & D of Ministry of Defense, R & D TNI AD, and R & D TNI AL, there are research activities in the form of studies involving personnel structurally. After being scrutinized, the team formed was supervised by the Head of the Human Resources sub directorate, where no one personnel from the alumni training program on research and development management of first-level defense were involved in the team. This means that all of them are structural officials who are the research team.

That this program can make changes to the role of training participants by improving the ability of ordinary employees to be educated and developed into professional researchers. Supported by coach factors and relationships with participants ( Piyali et al. 2012) being the most effective variables in the training. This is not done comprehensively, so TNI personnel who have attended training on research and development management of first-level defense have not been empowered in the research work, and their competence cannot be utilized for organizations in conducting synergistic research and team.

This contrasts with the building of competence and high motivation (Labadie et al., 2017) shown by the training participants in following the whole set of materials. All the newness values obtained during the training, ended and cannot be applied for the assignment, because the work orientation is different. Similarly (Allal-Chérif and Midwife 2017) programs developed at significant cost free of charge to training participants have no effect on organizational culture of R & D and uninvolved working relationships. Innovation of instructors (Harris 20 14) and (Harris et al 20 14) who prepare all their resources and efforts to find a training catalyst, so that the Training Board as an organizer and R & D agency as a sending organization do not become socially disadvantaged, because human capital is not achieved. R & D performance is influenced by the interaction between actors in innovation (Chen and Hung 2016)[ 13] mainly technology innovation strategy into Indonesia's defense industry policy does not overshadow training out. So that the training outputs are not able to answer the R & D objectives undertaken by the company, and analyze the financial impact, knowledge, and market barriers to R & D innovation as the reference is used (Costa-Campi, Duch-Brown and García-Quevedo 20 14)[14].

Stages of Result

Starting from examining organizational performance models with human capital and social capital as mediators, ( Subramony et al., 2018) is primarily for building the knowledge, skills, and intrapersonal skills of leaders. The realization of quality research, full of innovation and challenging future strengths into an organizational performance assessment determined by the influence of leaders in running strict rules / policies, this will be correlated with R & D ( Ghisetti and Pontoni 2015) as an organization.

Fundamentally, the analysis of training needs to increase knowledge, skills, and competence as a researcher does not contribute to the performance within the organization. Judging from the contribution of alumni works as a team in conducting research in R & D agency is very low, it can be interpreted the implementation of training need to be evaluated fundamentally. An alternative to be able to accommodate the competence of alumni of training to be empowered is the commitment of leadership in the effort to maximize the training competence, and the opening of functional position of researcher for TNI soldier as career path.

Conclusions

  • Participants' reactions to the training of research programs on research and development management of first-level defense showed satisfactory reaction both from the curriculum, teaching materials, teaching staff, learning methods used and the learning media, committees, and facilities available.

  • Achievement of learning outcomes that have increased by comparing the results of pre-test and post test; then the acquisition of average achievement score of participants by 80%, so that the training participants can be declared passed and have increased competence. High motivation has encouraged each participant able to prepare a research proposal, mastering methodology, able to formulate / make research instrument, able to process data, and competent to make a report of research results.

  • The evaluation results on the behavior stage, which shows that the alumni are not maximal in applying the skills, and knowledge gained from the training. This is caused by the source of the training participants are mostly not from the research institution so that after the training the participants return to the unity of origin that is not in accordance with the competence of the researcher.

  • The result from the evaluation shows that the training on research and development program of first-level defense does not give a significant impact to the organization, especially the existing R & D institutions, both within Kemhan and R & D within the TNI. This is because some alumni are not enabled or not empowered because they are not assigned to R & D institutions. The alumni do not conduct research that can be used by the organization because they do not carry out research work according to their competence, so there is no research work produced as an institution product.

  • Equalize the length of your columns on the last page. If you are using Word, proceed as follows: Insert/Break/Continuous.

References

  1. Investigating policy and R&D effects on environmental innovation: A meta-analysis Ghisetti Claudia, Pontoni Federico. Ecological Economics.2015-oct;:57-66. CrossRef Google Scholar
  2. Human Capital Practices Drive Innovation in Romania Alexe C\uat\ualina-Monica, Alexe C\uat\ualin-George. Procedia Engineering.2017;:943-950. CrossRef Google Scholar
  3. Human Capital and Innovation Capacity of Firms in Defense and Aviation Industry in Ankara Koroglu BilgeArmatl\i, Eceral TanyelOzelci. Procedia - Social and Behavioral Sciences.2015-jul;:1583-1592. CrossRef Google Scholar
  4. When in Rome: Intercultural learning and implications for training Morris MichaelW, Savani Krishna, Mor Shira, Cho Jaee. Research in Organizational Behavior.2014;:189-215. CrossRef Google Scholar
  5. Leadership development practice bundles and organizational performance: The mediating role of human capital and social capital Subramony Mahesh, Segers Jesse, Chadwick Clint, Shyamsunder Aarti. Journal of Business Research.2018-feb;:120-129. CrossRef Google Scholar
  6. Towards more effective training programmes: a study of trainer attributes Ghosh Piyali, Satyawadi Rachita, Joshi JagdambaPrasad, Ranjan Rashmi, Singh Priya. Industrial and Commercial Training.2012-jun;:194-202. CrossRef Google Scholar
  7. Significant tasks in training of job-shop supervisors Pederson LeonardS, Dresdow Sally, Benson Joy. Journal of Workplace Learning.2013-jan;:23-36. CrossRef Google Scholar
  8. Do trainer style and learner orientation predict training outcomes? Harris TBrad, Chung Wonjoon, Hutchins HollyM, Chiaburu DanS. Journal of Workplace Learning.2014-jul;:331-344. CrossRef Google Scholar
  9. New cross-proposal entrepreneurship and innovation in educational programs in third level (tertiary) education Gutiérrez JorgeGámez, Baquero JossieEstebanGarzón. Contaduría y Administración.2017-jan;:239-261. CrossRef Google Scholar
  10. Assessing the Effect of an Intensive 2-Week Surgical Training and Innovation Program for High-School Students Labadie Brian, Patel RoshanM, Labadie JessicaGandy, Hwang Christina, Okhunov Zhamshid, Landman Jaime. Journal of Surgical Education.2017-nov;:958-967. CrossRef Google Scholar
  11. The theory of change of the evaluation support program: Enhancing the role of community organizations in providing an ecology of care for neurological disorders Arasanz Carla, Nylen Kirk. Evaluation and Program Planning.2017-may. CrossRef Google Scholar
  12. Collaborative open training with serious games: Relations, culture, knowledge, innovation, and desire Allal-Chérif Oihab, Bidan Marc. Journal of Innovation & Knowledge.2017-jan;:31-38. CrossRef Google Scholar
  13. An actor-network perspective on evaluating the R&D linking efficiency of innovation ecosystems Chen Ping-Chuan, Hung Shiu-Wan. Technological Forecasting and Social Change.2016-nov;:303-312. CrossRef Google Scholar
  14. R&D drivers and obstacles to innovation in the energy industry Costa-Campi MT, Duch-Brown N, García-Quevedo J. Energy Economics.2014-nov;:20-30. CrossRef Google Scholar
  15. Trainer attributes as drivers of training effectiveness Chukwu GosimMartin. Industrial and Commercial Training.2016-sep;:367-373. CrossRef Google Scholar
  16. Human Capital Management – Achieving Added Value through People20072Angela Baron and Michael Armstrong. Human Capital Management – Achieving Added Value through People. London and Philadelphia: Kogan Page 2007. 226pp, ISBN: 0749449381 UK £29.99 (hardback) Cattell Alan. Industrial and Commercial Training.2007-oct;:401-402. CrossRef Google Scholar
  17. EVALUASI PROGRAM BSE (BUKU SEKOLAH ELEKTRONIK) DI SMP NEGERI KOTA YOGYAKARTA Suharyadi Aris, Jabar CepiSafruddinAbdul. Jurnal Akuntabilitas Manajemen Pendidikan.2016-apr. CrossRef Google Scholar
  18. Sumbangsih Juhani Pallasmaa dalam Teori Arsitektur Sabatini StefaniNatalia, Kurniati andFeni, Haristianti Vika, Sudrajat Iwan, and and. Review of Urbanism and Architectural Studies.2017-dec;:49-60. CrossRef Google Scholar
  19. MANAJEMEN DALAM TEORI DAN PRAKTIK Ngumar Sutjipto. EKUITAS (Jurnal Ekonomi dan Keuangan).2016-nov. CrossRef Google Scholar
  20. Employee Training and Development, 4th edition20071Raymond A. Noe. Employee Training and Development, 4th edition. New York: McGraw-Hill Irwin 2008. xv $\mathplus$ 536 pp., ISBN: hardback US$79.99 Hossan ChowdhuryGolam. Management Research News.2007-nov;:955-956. CrossRef Google Scholar
  21. Intervensi Manajemen Sumberdaya Manusia dan Dampaknya terhadap Kesiapan Sivitas Akademika untuk Berubah and MisbahuddinAzzuhri. Jurnal Aplikasi Manajemen.2016-dec;:778-787. CrossRef Google Scholar

Author's Affiliation

  • I Nyoman Astawa

    Google Scholar

  • Muchlis R. Luddin

    Google Scholar

  • Ma’ruf Akbar

    Google Scholar

Copyrights & License

Article Details


Issue: Vol. 6 No. 04 (2018)
Page No.: EM-2018-236-242
Section: Economics and Management
DOI: https://doi.org/10.18535/ijsrm/v6i4.em01

How to Cite

Astawa, I. N., Luddin, M. R., & Akbar, M. (2018). Evaluation of Course Training Program on Research And Development Management of First Level Defense at Research and Development Agency of Defense Ministry Republic of Indonesia. International Journal of Scientific Research and Management, 6(04), EM-2018. https://doi.org/10.18535/ijsrm/v6i4.em01

Download Citation

  • HTML Viewed - 159 Times
  • PDF Downloaded - 53 Times
  • XML Downloaded - 26 Times