Introduction
In western societies, the quality of public and private healthcare services is commonly evaluated by measuring user satisfaction1. The interest in seeking the opinions of users has at least a triple justification: first, from the point of view of social participation, emphasis has been placed on citizens being an integral and central part of the system, participating actively in the evaluation, planning, and redefining of healthcare policies2; second, it is the users who can monitor and ultimately judge the quality of service since the subjective perception of the user speaks of the quality of the service combining their needs with their expectations3; and third, measuring satisfaction of the users is of great importance because it is proven that a satisfied patient is more disposed to following medical advice and treatment, and thus, to improve their health4.
Over 120 million Mexicans are potential users of healthcare services in one of Mexico's health subsystems. These subsystems can be classified into three groups: the social security institutions, the institutions that provide services to the population without social security, and the private sector. The formal sector workers and their families obtain healthcare services mainly through one social security entity called the Mexican Social Security Institute (IMSS, for its Spanish acronym). The IMSS is responsible for providing healthcare services to approximately 62 million potential clients, and it is financed by the earmarked employee, employer payroll taxes, and legally mandated government contributions5.
Patient satisfaction with care has been described as a multidimensional concept. Parasuraman et al. developed the Service Quality Questionnaire (SERVQUAL) for its use by service and retail organizations. According to these authors, there are five dimensions to service quality: reliability (the ability to carry out the promised service reliably and accurately), tangibles (equipment, physical facilities, and staff appearance), assurance (employee courtesy and knowledge, and their ability to inspire confidence and trust), responsiveness (the effort to help customers and provide fast service), and empathy (individualized attention the firm provides its clients)6. Although SERVQUAL was initially designed for application within financial service areas, the model is intended for a wide range of services, and its potential usefulness in a hospital environment has been evaluated and proven7,8. By using SERVQUAL as a guide, the Service Quality in Hospital Questionnaire (SERVQHOS) was developed for its use in the healthcare sector in Spanish-speaking countries9. We have chosen SERVQHOS as the measurement tool for assessing satisfaction because it is a brief questionnaire that is easy to complete, and it is broadly used in Spanish-speaking countries as a validated questionnaire10. This study aimed to describe parental satisfaction with healthcare during their child's hospitalization in a pediatric social security facility in Mexico.
Methods
Study population
This cross-sectional study consisted of parents of pediatric patients hospitalized in an academic, tertiary care pediatric medical facility in western Mexico. The facility offers care for children < 16 years of age. In 2018, the capacity of the pediatric and surgical wards was 250 beds, with 8,834 admissions, 3,979 surgical procedures, and 92,847 outpatient visits. The questionnaire was given between February and May 2019 to all parents who consented to participate and could read and write in Spanish.
Measurements
The SERVQHOS questionnaire is divided into three sections. The first section included 19 items measuring perception of several factors that influence the quality of assistance rated on a 5-point Likert scale, where 1 = much worse than expected; 2 = worse than expected; 3 = as expected; 4 = better than expected; 5 = much better than expected. Patients had to answer the question, “How did you find the quality of assistance on the following aspects?”, rating from 1 to 5. The 19 aspects included the five dimensions of service quality: reliability, tangibles, assurance, responsiveness, and empathy. The items could also be divided into subjective quality (human assistance) and objective quality (organizational and facility issues)9.
The second section included questions regarding overall satisfaction (rated on a 4-point Likert scale, where 1 = very dissatisfied, 2 = dissatisfied, 3 = satisfied, and 4 = very satisfied). For example, if the length of stay was appropriate, if they would recommend the hospital, if the hospitalization was scheduled or urgent, the number of hospital admissions in the last year, whether the information received was adequate, and whether they knew the name of the doctors and nurses.
The third section included socio-demographic data like sex, age, marital status, educational level, and employment status. In the end, free space was provided for feedback. The SERVQHOS is a generic, non-surgery-specific questionnaire. The instrument showed a Cronbach's alpha for the domains ranging from 0.89 to 0.95 (overall scale: 0.92)9,10.
Procedure
The questionnaires were delivered to the parents during child discharge. A trained social worker informed the parents about the purpose and the importance of their participation and gave an informed consent form to be signed. The questionnaire was provided with a blank envelope. Parents answered the questionnaire, placed it inside the envelope, and sealed it. The time to complete the questionnaire was 10 minutes. The social worker was available for clarifications as needed while parents responded to the questionnaire. One member of the team collected the sealed envelopes daily. Neither the questionnaire nor the envelope contained any questions or distinguishing signs leading to the identification of the participants. Regardless, the anonymity of the participants was ensured. No material or financial compensation was provided to participants. The local Research and Ethics Committee of the Mexican Social Security Institute approved the study protocol (CLIS R-2019-1302-011).
Statistical analysis
A pre-analysis power calculation gave the study > 84% power, α = 0.05, with a sample size of 425. Initially, 425 questionnaires were delivered, but parent surveys with more than 50% of unanswered questions were excluded from the analysis, which occurred in 24 (5.6%) of the surveys. Data were presented as mean ± standard deviation (SD), median, or percentages as appropriate. We performed logistic regression analyses in those factors statistically associated with overall satisfaction when comparing the very satisfied group vs. the other categories, including marital status (having a couple vs. not having a couple), level of education (secondary education or less), scheduled hospital admission, and have received enough information about child health status. The standardized regression coefficient and R2 determination coefficients were calculated. Data were analyzed with the SPSS Statistical Software Package (version 20.0 for Windows; SPSS, Inc., Chicago, IL). A value of p<0.05 was considered statistically significant.
Results
Demographics and quality evaluation
The population consisted of 401 parents (401 pediatric patients). The parents' mean age was 33 ± 8 years old, most of the participants were women 302 (75%), 322 (80%) had a couple (including married and common law), 218 (54%) completed at least secondary school education, and 204 (50%) were homemakers. The demographic characteristics of the parents are summarized in Table 1.
Total population | Comparison between groups | p-values | ||
---|---|---|---|---|
Very satisfied | Others | |||
n = 401 (%) | n = 78 (%) | n = 323 (%) | ||
Age | ||||
Mean ± SD | 33 ± 8 | 33 ± 8 | 34 ± 8 | 0.34 |
Sex | ||||
Female | 302 (75) | 55 (70) | 247 (76) | 0.344 |
Male | 97 (24) | 22 (28) | 75 (23) | |
Not available | 2 (0.5) | 1 (1.2) | 1 (0.3) | |
Marital status | ||||
Having couple | 322 (80.2) | 55 (70.5) | 267 (82.6) | 0.056 |
Not having couple | 75 (18.7) | 20 (25.6) | 55 (17.0) | |
Not available | 4 (0.9) | 3 (3.8) | 1 (0.3) | |
Education level | ||||
Secondary or less | 218 (54.3) | 52 (66.6) | 166 (51.3) | 0.016 |
Preparatory or higher | 181 (45.1) | 25 (32.0) | 156 (48.2) | |
Not available | 2 (0.4) | 1 (1.2) | 1 (0.3) | |
Occupation | ||||
Homemaker | 204 (50.8) | 42 (53) | 162 (50) | 0.563 |
Student | 6 (1.4) | 2 (2) | 4 (1) | |
Employed | 187 (46.6) | 33 (42) | 154 (47) | |
Retired | 2 (0.4) | 0 (0) | 2 (0.6) | |
Not available | 2 (0.4) | 1 (1) | 1 (0.3) |
SD, standard deviation.
The results of the quality first section of the SERVQHOS questionnaire are presented as a mean and SD of a 5-point Likert scale rate (Table 2). Among the best-rated aspects were those related to objective quality (tangibles dimension): modern equipment technology, 3.68 ± 0.86; hospital employee appearance, 3.65 ± 0.84; and subjective quality (assurance dimension), including the ability to inspire trust and confidence (3.66 ± 0.83), employee courtesy (3.65 ± 0.83), and nursing staff interest in patients (3.65 ± 0.85). However, the aspects that users rated worst were those related to objective quality (reliability dimension): waiting time for services (3.37 ± 0.82) and timeliness at the doctor's visit (3.34 ± 0.80), as well as (tangibles dimension) room conditions (3.46 ± 0.82) and ease of getting to the hospital (3.40 ± 0.85).
Evaluation | Score | Much worse/Worse | Much better/Better | |
---|---|---|---|---|
Mean ± SD | n (%) | n (%) | n (%) | |
Total satisfaction with care | 3.63 ± 0.79 | 6 (1.4) | 208 (51.8) | 187 (46.6) |
Objective quality | ||||
Tangibles | ||||
Modern equipment technology | 3.68 ± 0.86 | 6 (1.4) | 209 (52.1) | 186 (46.3) |
Hospital employee appearance | 3.65 ± 0.84 | 7 (1.7) | 213 (53.1) | 181 (45.1) |
Location directions | 3.54 ± 0.81 | 11 (2.7) | 227 (56.6) | 163 (40.6) |
Room conditions | 3.46 ± 0.82 | 20 (4.9) | 223 (55.6) | 158 (39.4) |
Ease of getting to the hospital | 3.40 ± 0.85 | 26 (6.4) | 229 (57.1) | 146 (36.4) |
Reliability | ||||
Accomplishment of promised services | 3.59 ± 0.81 | 10 (2.4) | 215 (53.6) | 176 (43.8) |
Waiting time for service | 3.37 ± 0.82 | 28 (6.9) | 238 (59.3) | 135 (33.6) |
Timeliness of doctor's visit | 3.34 ± 0.80 | 34 (8.4) | 231 (57.6) | 136 (33.9) |
Subjective quality | ||||
Responsiveness | ||||
Sincere interest in solving problems | 3.55 ± 0.80 | 12 (2.9) | 218 (54.3) | 171 (42.6) |
Provision of prompt services | 3.47 ± 0.78 | 19 (4.7) | 226 (56.3) | 156 (38.9) |
Willingness to help patients | 3.62 ± 0.84 | 11 (2.7) | 209 (52.1) | 181 (45.1) |
Assurance | ||||
Ability to inspire trust and confidence | 3.66 ± 0.83 | 9 (2.2) | 200 (49.8) | 192 (47.8) |
Employee courtesy | 3.65 ± 0.83 | 5 (1.2) | 212 (52.8) | 184 (45.8) |
Employees professional skills | 3.62 ± 0.82 | 9 (2.2) | 212 (52.8) | 180 (44.8) |
Nursing staff interest in patients | 3.65 ± 0.85 | 6 (1.4) | 215 (53.6) | 180 (44.8) |
Empathy | ||||
Individual personal attention | 3.62 ± 0.83 | 9 (2.2) | 213 (53.1) | 179 (44.6) |
Understanding of specific patients' needs | 3.56 ± 0.79 | 8 (1.9) | 225 (56.1) | 168 (41.8) |
Objective quality | ||||
Others | ||||
Information about treatments | 3.58 ± 0.86 | 18 (4.4) | 208 (51.8) | 175 (43.6) |
Information to relatives/families | 3.56 ± 0.84 | 15 (3.7) | 220 (54.8) | 166 (41.3 |
SD, standard deviation.
Satisfaction evaluation
The results of the satisfaction second section of the questionnaire are shown in Table 3. The overall satisfaction with care was rated on a 4-point Likert scale as follows: very dissatisfied (0%), 8 dissatisfied (1.9%), 315 satisfied (78.5%), and 78 very satisfied parents (19.4%); additionally, 388 parents (96%) would not hesitate to recommend the hospital to others. Also, 382 parents (95%) believed that their child stayed in the hospital necessary length of time, and 394 parents (98%) responded that their child did not undergo medical tests without permission. However, 39 parents (9%) did not know the name of the doctor who treated their child during hospitalization, and 29 parents (7%) did not know the nurse's name. The free space for feedback was used by 96 parents (23.9%) who gave one or more comments or suggestions: 27 acknowledgments/words of gratitude (28%), and 69 complaints (72%) about the facilities, catering services, the care received by staff, and the lack of personnel.
Total population | Comparison between groups | p-values | ||
---|---|---|---|---|
Very satisfied | Others | |||
n = 401 (%) | n = 78 (%) | n = 323 (%) | ||
Would you recommend this hospital? | ||||
Yes, no doubt | 388 (96.4) | 78 (100) | 310 (96) | |
I am not sure | 12 (3.2) | 0 (0) | 12 (3) | |
Never | 0 (0) | 0 (0) | 0 (0) | |
Information unavailable | 1 (0.2) | 0 (0) | 1 (0.3) | 0.197 |
Your patient underwent a medical test without your permission? | 0.423 | |||
No | 394 (98.2) | 78 (100) | 316 (98) | |
Yes | 6 (1.4) | 0 (0) | 6 (1) | |
Information unavailable | 1 (0.2) | 0 (0) | 1 (0.3) | |
Do you believe the length of stay of your child was | ||||
Shorter than necessary | ||||
Adequate | 5 (1.2) | 2 (2) | 3 (0.9) | 0.432 |
Longer than necessary | 382 (95.2) | 75 (96) | 307 (95) | |
Information unavailable | 13 (3.2) | 1 (1) | 12 (3) | |
1 (0.2) | 0 (0) | 1 (0.3) | ||
Do you know your doctor's name? | ||||
Yes | 361 (90) | 69 (88) | 292 (90) | 0.742 |
No | 39 (9.7) | 9 (11) | 30 (9) | |
Information unavailable | 1 (0.2) | 0 (0) | 1 (0.3) | |
Do you know your nurse's name? | ||||
Yes | 371 (92.5) | 70 (89) | 301 (93) | 0.098 |
No | 29 (7.2) | 7 (8) | 22 (6) | |
Information unavailable | 1 (0.2) | 1 (1) | 0 (0) | |
Do you get enough information? | ||||
Yes | 347 (86.5) | 75 (96) | 272 (84) | 0.001 |
No | 53 (13.2) | 2 (2) | 51 (15) | |
Information unavailable | 1 (0.2) | 1 (1) | 0 (0) | |
Hospital admission | ||||
Emergency | 222 (55.3) | 34 (43) | 188 (58) | 0.056 |
Scheduled | 173 (43.1) | 42 (53) | 131 (40) | |
Information unavailable | 6 (1.4) | 2 (2) | 4 (1) | |
Number of admissions during the last year | ||||
Mean | 1.9±2.7 | 1.7±1.3 | 2.1±2.5 | 0.055 |
Hospitalization service evaluated | ||||
Cardiac surgery | 4 (0.99) | 0 (0) | 4 (100) | |
Cardiology | 58 (14.4) | 7 (12) | 51 (88) | |
Maxillofacial surgery | 1 (0.2) | 0 (0) | 1 (100) | |
Pediatric surgery | 36 (8.9) | 4 (11) | 32 (89) | |
Plastic surgery | 9 (2.2) | 3 (33) | 6 (67) | |
Endocrinology | 5 (1.2) | 0 (0) | 5 (100) | |
Gastroenterology | 23 (5.7) | 5 (22) | 18 (78) | |
Hematology | 32 (7.9) | 6 (19) | 26 (81) | |
Infectology | 3 (0.7) | 0 (0) | 3 (100) | |
Internal medicine | 6 (1.4) | 2 (33) | 4 (67) | |
Nephrology | 8 (1.9) | 1 (12) | 7 (88) | |
Neonatology | 7 (1.7) | 1 (14) | 6 (86) | |
Respirology | 11 (2.7) | 2 (18) | 9 (82) | |
Neurosurgery | 10 (2.4) | 0 (0) | 10 (100) | |
Neurology | 35 (8.7) | 3 (8) | 32 (92) | |
Oncology | 28 (7.2) | 2 (7) | 26 (93) | |
Otorhinolaryngology | 3 (0.7) | 1 (33) | 2 (67) | |
Orthopedics | 6 (1.4) | 2 (33) | 4 (67) | |
Pediatrics | 17 (4.2) | 7 (41) | 10 (59) | |
Rheumatology | 3 (0.7) | 2 (67) | 1 (33) | |
Emergency | 48 (11.7) | 15 (31) | 33 (69) | |
Urology | 13 (3.2) | 5 (38) | 8 (62) | |
Information unavailable | 35 (8.7) | 10 (29) | 25 (71) |
Comparisons between groups
To know which factors determined satisfaction in our population, we grouped the parents into two groups: those who rated the attention as ‘very satisfied' 78 (19.4%) and those who rated the rest of the categories as dissatisfied and satisfied 323 (80.5%). We did not observe any significant differences in age, sex, and occupation upon comparing the demographic characteristics. In contrast, we observed a tendency concerning having a couple or not (including married and common law) (p = 0.056) and a statistically significant difference regarding the level of education (secondary education or less) (p = 0.016) (Table 1). When comparing the first section of the SERVQHOS questionnaire results between the very satisfied group and the rest of the categories, we observed statistically significant differences (p = 0.001) in the 19 questions of that section. Conversely, for the seven questions that comprise the second section of the questionnaire, we only observed a significant difference for the question “Did you get enough information?” (p = 0.001) (Table 3).
With this information, we performed a multiple logistic regression analysis, considering the level of satisfaction of ‘very satisfied' as a dependent variable and the variables that were found to be significant in the bivariate analysis as predictors: not having a couple (p = 0.056), secondary level of education or less (p = 0.016), having received enough information (p = 0.001), and type of hospital admission (p = 0.056). This model achieved an explanatory power on the variable ‘very satisfied' from 53% to 83% (R squared of Cox and Snell: 0.52; and R squared of Nagelkerke: 0.83, respectively); however, the variables not having a couple and secondary level of education or less were not statistically significant in this model (Table 4).
Discussion
The Mexican health care system seems to be overstretched, and healthcare quality has remained unsatisfactory for most of the population. A 2006 national survey found substantial heterogeneity in healthcare quality assessments across healthcare subsystems, favoring private providers over social security institutions.
Moreover, 76% of Mexicans thought their health system needed fundamental changes11. As a result of the healthcare system overhaul, the quality of care has become increasingly important. Furthermore, experts emphasize that the results of patient satisfaction questionnaires will be required by insurance companies and care providers12-14.
Methods that measure patient satisfaction are not well applied in specific populations like children, who have difficulties expressing their views directly15. In contrast, a quality assessment of parental satisfaction with service provision is particularly challenging and rarely undertaken16. Parental satisfaction has been used successfully to measure quality for pediatric patients' attention as it is closely linked to the adequacy of children's treatment and staff performance in pediatric practice17. A thorough review of the literature revealed a lack of studies that have examined a broader perspective of parents' views on the quality of pediatric ward healthcare. Previous studies have been focused on specific areas such as emergency care18, intensive pediatric care19, neonatal intensive care20, and pain management21 or parental involvement in the care of their child22.
This study analyzed the perceived parental quality and satisfaction with healthcare in tertiary care, social security, pediatric facility. We achieved a participation rate of 94% in our study, which is quite similar to the Arrebola-Pajares et al. study in Spain, with a participation rate of 92% using the same SERVQHOS questionnaire but in adult patients with urological conditions23. In our unit, the quality issues rated worst by parents were aspects concerning objective quality (waiting time for service, punctuality of doctor's visit, room conditions, and ease of getting to the hospital); this situation has also been highlighted in other surveys using SERVQHOS23,24. The best-rated aspects were objective quality (modern equipment technology) and subjective quality (ability to inspire trust and confidence, employee courtesy, and nursing staff interest in patients). Similar results but higher mean scores were reported in the study of Gomez et al. applied to adult patients from a burn unit in Spain24. Our results demonstrate a high level of overall parental satisfaction: 78% satisfied and 19% very satisfied, while dissatisfaction rated as ‘not very satisfied' was only 2%, similar to that published by Perez et al., where they referred to dissatisfaction ranging from 2.9% to 2.5% when comparing a public healthcare center vs. a private institution25. To the best of our knowledge, this is the first time the SERVQHOS questionnaire has been applied to parents of pediatric patients. Therefore, we cannot make specific comparisons at this time, unfortunately.
Few of the parents did not know the name of the doctor who attended their child (9%), while the name of the nurse was unknown to a slightly lower percentage (7%). This lack of awareness could be caused by staff rotations: a high percentage of its eventuality occurs in our facility, which did not allow identification of a nurse as a point of reference. Knowing the name of the person who provides services improves the achievement of treatment in patients. Our results are better than those published by other authors, where the percentages varied from 20% to 40%. However, this aspect should be improved24,25. Regarding the number of previous hospitalizations, our results are consistent with the study performed by Ygge et al., where parents whose child was hospitalized several times in the past expressed lower levels of satisfaction26.
In the logistic regression analysis, we observed that the variables of having received enough information and pre-scheduled hospitalization were the most influencing factors on the overall satisfaction in parents, achieving an explanatory power from 52% al 83%. In contrast to other studies, we did not observe a significant difference in marital status variables and level of education27. In the present study, the questions regarding treatments and information to relatives/families were scored low (3.58 and 3.56 points, respectively). Moreover, 13% of the parents referred not having received enough information, a result lower than Tolosa et al. study in a public hospital in Colombia, where 31% of parents referred dissatisfied with the information provided28.
In the free space for feedback, the parents mainly complained about not having enough information about the illness, the resolution of doubts in an everyday language, and uncertainty about the outcome of the illness and the evolution of the patient. These grievances fit into the three domains proposed in the taxonomy of Reader et al.29, in which communication is a common complaint issue. This finding agrees with previous publications that report significant problems in staff-patient relationships and communication between staff and patients30.
The limitations of our study include that it was conducted at a single-center tertiary level facility, which limits the generalizability since the experiences of parents of children admitted in other contexts may vary. The use of questionnaires to evaluate the level of satisfaction is a simple and effective tool, but it depends on the expectations of the parents: if parental expectations are low, their perceptions of the quality received will be better. Although the hospital from which the sample was drawn is the most extensive pediatric facility in the northwest of Mexico, the results should be interpreted with caution because it is unclear how these findings represent parental satisfaction in other pediatric wards of the IMSS healthcare network.